Sep 10 20:52:34.029108 ip-10-0-142-97 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 20:52:34.029118 ip-10-0-142-97 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 20:52:34.029127 ip-10-0-142-97 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 20:52:34.029335 ip-10-0-142-97 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 20:52:44.175910 ip-10-0-142-97 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 20:52:44.175926 ip-10-0-142-97 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dbf9ef248f7e4d9399e5e7f67e2619da -- Sep 10 20:54:40.663891 ip-10-0-142-97 systemd[1]: Starting Kubernetes Kubelet... Sep 10 20:54:41.084542 ip-10-0-142-97 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 20:54:41.084542 ip-10-0-142-97 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 20:54:41.084542 ip-10-0-142-97 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 20:54:41.084542 ip-10-0-142-97 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 20:54:41.084542 ip-10-0-142-97 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 20:54:41.087435 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.087330 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 20:54:41.091358 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091340 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 20:54:41.091358 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091358 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 20:54:41.091358 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091362 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091365 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091368 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091371 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091374 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091377 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091380 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091383 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091386 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091389 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091391 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091394 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091397 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091401 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091406 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091410 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091413 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091416 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091419 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 20:54:41.091505 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091422 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091425 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091428 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091430 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091433 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091436 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091438 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091441 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091443 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091446 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091449 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091451 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091454 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091457 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091459 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091462 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091465 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091468 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091471 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091474 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 20:54:41.092209 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091477 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091479 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091482 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091484 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091487 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091490 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091493 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091496 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091498 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091501 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091503 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091506 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091508 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091511 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091514 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091517 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091519 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091523 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091525 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091528 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 20:54:41.093009 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091531 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091533 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091536 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091539 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091543 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091546 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091550 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091554 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091557 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091574 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091578 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091581 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091584 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091587 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091590 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091593 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091595 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091598 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091600 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 20:54:41.093750 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091603 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091606 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091608 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091611 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091613 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091616 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091618 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091622 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091624 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091627 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091630 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091632 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091635 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091638 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091640 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091643 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091645 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091648 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.091650 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093821 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 20:54:41.094442 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093829 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093833 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093837 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093840 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093844 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093847 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093849 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093852 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093854 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093857 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093860 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093862 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093865 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093868 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093870 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093873 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093876 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093879 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093882 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093886 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 20:54:41.095193 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093889 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093892 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093895 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093898 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093901 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093903 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093906 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093908 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093911 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093914 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093916 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093919 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093921 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093924 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093926 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093929 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093931 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093934 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093937 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093939 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 20:54:41.095962 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093942 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093944 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093947 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093949 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093952 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093954 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093957 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093960 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093962 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093965 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093967 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093970 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093973 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093975 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093978 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093981 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093983 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093986 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093988 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093991 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 20:54:41.096877 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093994 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.093998 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094001 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094005 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094010 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094014 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094017 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094020 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094022 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094025 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094028 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094032 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094034 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094037 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094040 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094043 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094045 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094048 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 20:54:41.097631 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094050 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094053 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094056 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094058 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094061 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094063 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094066 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094069 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094071 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094074 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094077 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094080 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094082 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094085 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094087 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094090 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094092 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094095 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094097 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094100 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 20:54:41.098299 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094486 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094492 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094497 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094501 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094504 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094508 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094511 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094513 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094516 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094519 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094522 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094525 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094528 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094531 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094533 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094536 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094538 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094541 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094544 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 20:54:41.099039 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094547 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094549 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094553 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094557 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094576 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094580 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094583 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094585 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094588 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094591 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094593 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094596 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094598 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094601 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094604 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094608 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094610 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094613 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094616 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094619 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 20:54:41.099768 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094622 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094624 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094627 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094630 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094633 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094635 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094638 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094641 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094644 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094646 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094650 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094652 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094655 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094657 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094660 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094663 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094665 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094668 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094671 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094673 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 20:54:41.100477 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094676 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094678 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094681 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094684 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094686 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094689 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094692 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094695 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094697 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094700 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094702 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094705 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094708 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094710 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094713 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094715 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094719 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094723 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094725 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 20:54:41.101230 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094728 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094731 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094734 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094737 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094739 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094742 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094744 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094747 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094750 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094752 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094755 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094757 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094760 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094762 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094765 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094767 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094770 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094772 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094775 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094778 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 20:54:41.101955 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.094781 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094867 2563 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094905 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094912 2563 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094916 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094921 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094925 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094929 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094934 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094937 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094940 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094943 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094947 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094950 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094953 2563 flags.go:64] FLAG: --cgroup-root="" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094956 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094959 2563 flags.go:64] FLAG: --client-ca-file="" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094962 2563 flags.go:64] FLAG: --cloud-provider="external" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094965 2563 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094969 2563 flags.go:64] FLAG: --cluster-domain="" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094972 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094975 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094978 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094982 2563 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 20:54:41.102703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094988 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094991 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094994 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.094997 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095000 2563 flags.go:64] FLAG: --contention-profiling="false" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095004 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095007 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095010 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095012 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095016 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095020 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095022 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095025 2563 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095028 2563 flags.go:64] FLAG: --enable-server="true" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095034 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095039 2563 flags.go:64] FLAG: --event-burst="100" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095042 2563 flags.go:64] FLAG: --event-qps="50" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095045 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095048 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095051 2563 flags.go:64] FLAG: --eviction-hard="" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095055 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095058 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095061 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095064 2563 flags.go:64] FLAG: --eviction-soft="" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095067 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 20:54:41.103587 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095070 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095073 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095076 2563 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095079 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095081 2563 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095084 2563 flags.go:64] FLAG: --feature-gates="" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095088 2563 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095093 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095096 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095099 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095102 2563 flags.go:64] FLAG: --healthz-port="10248" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095105 2563 flags.go:64] FLAG: --help="false" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095108 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095111 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095114 2563 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095117 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095121 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095126 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095128 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095131 2563 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095134 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095137 2563 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095141 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095144 2563 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 20:54:41.104553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095147 2563 flags.go:64] FLAG: --kube-reserved="" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095150 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095153 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095156 2563 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095159 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095161 2563 flags.go:64] FLAG: --lock-file="" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095164 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095167 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095170 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095176 2563 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095179 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095182 2563 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095185 2563 flags.go:64] FLAG: --logging-format="text" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095188 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095191 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095195 2563 flags.go:64] FLAG: --manifest-url="" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095198 2563 flags.go:64] FLAG: --manifest-url-header="" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095203 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095206 2563 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095210 2563 flags.go:64] FLAG: --max-pods="110" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095213 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095216 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095220 2563 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095223 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095226 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 20:54:41.105491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095230 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095233 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095241 2563 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095244 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095247 2563 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095250 2563 flags.go:64] FLAG: --pod-cidr="" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095254 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095259 2563 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095263 2563 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095266 2563 flags.go:64] FLAG: --pods-per-core="0" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095269 2563 flags.go:64] FLAG: --port="10250" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095272 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095274 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a73af08ecc0d126" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095278 2563 flags.go:64] FLAG: --qos-reserved="" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095281 2563 flags.go:64] FLAG: --read-only-port="10255" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095284 2563 flags.go:64] FLAG: --register-node="true" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095287 2563 flags.go:64] FLAG: --register-with-taints="" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095290 2563 flags.go:64] FLAG: --registry-burst="10" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095293 2563 flags.go:64] FLAG: --registry-qps="5" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095296 2563 flags.go:64] FLAG: --reserved-cpus="" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095299 2563 flags.go:64] FLAG: --reserved-memory="" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095304 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095308 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095312 2563 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095315 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 20:54:41.106615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095318 2563 flags.go:64] FLAG: --runonce="false" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095321 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095324 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095327 2563 flags.go:64] FLAG: --seccomp-default="false" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095330 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095333 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095336 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095340 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095344 2563 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095347 2563 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095350 2563 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095353 2563 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095356 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095360 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095363 2563 flags.go:64] FLAG: --system-cgroups="" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095366 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095372 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095374 2563 flags.go:64] FLAG: --tls-cert-file="" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095377 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095381 2563 flags.go:64] FLAG: --tls-min-version="" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095384 2563 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095386 2563 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095389 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095392 2563 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095395 2563 flags.go:64] FLAG: --v="2" Sep 10 20:54:41.107541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095399 2563 flags.go:64] FLAG: --version="false" Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095403 2563 flags.go:64] FLAG: --vmodule="" Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095406 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.095410 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095526 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095530 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095533 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095536 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095539 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095541 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095544 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095547 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095549 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095552 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095555 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095602 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095616 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095621 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095624 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095631 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 20:54:41.108481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095634 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095638 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095641 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095644 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095647 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095650 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095655 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095659 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095663 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095666 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095669 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095672 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095675 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095678 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095680 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095683 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095687 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095691 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095694 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 20:54:41.109255 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095697 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095700 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095703 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095705 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095708 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095711 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095714 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095716 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095719 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095724 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095727 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095730 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095732 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095735 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095738 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095740 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095743 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095746 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095749 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095752 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 20:54:41.109984 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095755 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095757 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095760 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095763 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095765 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095769 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095772 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095775 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095778 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095780 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095783 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095785 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095788 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095791 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095795 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095800 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095803 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095806 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095809 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095814 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 20:54:41.110794 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095817 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095820 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095824 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095827 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095829 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095832 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095834 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095837 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095841 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095843 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095846 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095849 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095852 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095854 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095858 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095861 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095863 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095866 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095869 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095872 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 20:54:41.111538 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095874 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095877 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095880 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.095883 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.097185 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.105665 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.105699 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.106539 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.106552 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106729 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106737 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106740 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106743 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106749 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106752 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 20:54:41.112290 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106755 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106759 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106762 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106765 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106767 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106770 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106773 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106777 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106780 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106783 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106800 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106803 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106806 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106934 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106942 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106945 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106948 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106951 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106954 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106956 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 20:54:41.112875 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106959 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106962 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106964 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106970 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106973 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106976 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106978 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106981 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106984 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106987 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106990 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106992 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106995 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.106998 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107001 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107004 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107006 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107009 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107012 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107015 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 20:54:41.113623 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107018 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107021 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107024 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107027 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107030 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107033 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107035 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107038 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107040 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107043 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107045 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107048 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107051 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107053 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107056 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107059 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107062 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107065 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107068 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107071 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 20:54:41.114371 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107073 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107076 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107079 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107081 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107084 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107086 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107089 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107092 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107094 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107097 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107100 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107103 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107105 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107110 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107115 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107122 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107128 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107132 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107136 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 20:54:41.115131 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107142 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107146 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107151 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107155 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107158 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107161 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107163 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107166 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107170 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107173 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107176 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107178 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107181 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107184 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 20:54:41.115884 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.107189 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107319 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107323 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107326 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107329 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107332 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107334 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107337 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107340 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107343 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107347 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107351 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107354 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107358 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107361 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107364 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107367 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107369 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107372 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 20:54:41.116411 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107375 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107378 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107381 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107384 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107387 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107390 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107393 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107395 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107398 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107401 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107404 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107407 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107409 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107412 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107414 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107417 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107420 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107422 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107425 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107428 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 20:54:41.117169 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107430 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107433 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107435 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107437 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107440 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107442 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107445 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107448 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107451 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107453 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107456 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107459 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107461 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107464 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107466 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107469 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107471 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107474 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107476 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107479 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 20:54:41.117963 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107482 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107484 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107487 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107490 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107492 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107495 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107498 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107500 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107502 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107505 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107507 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107510 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107512 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107515 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107517 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107520 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107524 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107527 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107530 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 20:54:41.118719 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107532 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107536 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107538 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107541 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107544 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107547 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107549 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107552 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107555 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107557 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107576 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107579 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107582 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107585 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107588 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107591 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107594 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107596 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107599 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107602 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 20:54:41.119481 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107605 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:41.107608 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.107613 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.107748 2563 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.109676 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.110678 2563 server.go:1019] "Starting client certificate rotation" Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.110779 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.110812 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.113195 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 20:54:41.120237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.114402 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 20:54:41.124025 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.124009 2563 log.go:25] "Validated CRI v1 runtime API" Sep 10 20:54:41.127066 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.127049 2563 log.go:25] "Validated CRI v1 image API" Sep 10 20:54:41.127993 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.127974 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 20:54:41.132075 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.132054 2563 fs.go:135] Filesystem UUIDs: map[0c1d9ae7-61c6-47d1-b43a-7cc269b3ee51:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b67bf987-93e9-4fe7-bb98-aa8d4f4c991a:/dev/nvme0n1p4] Sep 10 20:54:41.132154 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.132073 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 20:54:41.137235 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.137123 2563 manager.go:216] Machine: {Timestamp:2026-09-10 20:54:41.13567504 +0000 UTC m=+0.350230318 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097074 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29097d5d5dfa0f5d268db3e2cf99e8 SystemUUID:ec29097d-5d5d-fa0f-5d26-8db3e2cf99e8 BootID:dbf9ef24-8f7e-4d93-99e5-e7f67e2619da Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:ce:55:a4:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:ce:55:a4:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:b7:71:e1:bc:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 20:54:41.137235 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.137229 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 20:54:41.137339 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.137316 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 20:54:41.142093 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.142057 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 20:54:41.142235 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.142096 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 20:54:41.142730 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.142718 2563 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 20:54:41.142770 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.142733 2563 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 20:54:41.142770 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.142740 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 20:54:41.143512 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.143501 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 20:54:41.144175 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.144165 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 20:54:41.144912 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.144891 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 20:54:41.147877 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.147864 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 10 20:54:41.147993 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.147984 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 20:54:41.148026 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.148015 2563 kubelet.go:486] "Attempting to sync node with API server" Sep 10 20:54:41.148053 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.148029 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 20:54:41.148053 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.148044 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 20:54:41.148132 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.148059 2563 kubelet.go:398] "Adding apiserver pod source" Sep 10 20:54:41.148132 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.148068 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 20:54:41.148448 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.148435 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 20:54:41.148514 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.148455 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 20:54:41.150706 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.150688 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 20:54:41.152850 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.152836 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 20:54:41.152919 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.152866 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 20:54:41.154291 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154279 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 20:54:41.154340 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154296 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 20:54:41.154340 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154302 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 20:54:41.154340 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154307 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 20:54:41.154340 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154316 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 20:54:41.154340 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154322 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 20:54:41.154340 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154335 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 20:54:41.154340 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154340 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 20:54:41.154630 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154347 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 20:54:41.154630 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154352 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 20:54:41.154630 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154360 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 20:54:41.154630 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.154366 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 20:54:41.155164 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.155144 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 20:54:41.155164 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.155161 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 20:54:41.157130 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.157101 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 20:54:41.157130 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.157114 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 20:54:41.157231 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.157123 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 20:54:41.159162 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.159148 2563 server.go:1268] "Started kubelet" Sep 10 20:54:41.159239 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.159213 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 20:54:41.159404 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.159361 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 20:54:41.159481 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.159427 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 20:54:41.160136 ip-10-0-142-97 systemd[1]: Started Kubernetes Kubelet. Sep 10 20:54:41.161388 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.161325 2563 server.go:310] "Adding debug handlers to kubelet server" Sep 10 20:54:41.163106 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.163071 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 20:54:41.163544 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.163527 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 20:54:41.163765 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.163749 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbjk6" Sep 10 20:54:41.167335 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.167319 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 20:54:41.167950 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.167933 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 20:54:41.168302 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.168280 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.168670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.168649 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 20:54:41.168670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.168672 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 20:54:41.168825 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.168813 2563 reconstruct.go:97] "Volume reconstruction finished" Sep 10 20:54:41.168825 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.168826 2563 reconciler.go:29] "Reconciler: start to sync state" Sep 10 20:54:41.168910 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.168856 2563 factory.go:55] Registering systemd factory Sep 10 20:54:41.168910 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.168871 2563 factory.go:223] Registration of the systemd container factory successfully Sep 10 20:54:41.169011 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.168928 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 20:54:41.169302 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.169184 2563 factory.go:153] Registering CRI-O factory Sep 10 20:54:41.169302 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.169199 2563 factory.go:223] Registration of the crio container factory successfully Sep 10 20:54:41.169302 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.169279 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 20:54:41.169302 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.169299 2563 factory.go:103] Registering Raw factory Sep 10 20:54:41.169503 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.169313 2563 manager.go:1196] Started watching for new ooms in manager Sep 10 20:54:41.170552 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.170528 2563 manager.go:349] Starting recovery of all containers Sep 10 20:54:41.171001 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.170979 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbjk6" Sep 10 20:54:41.176325 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.176112 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 20:54:41.176325 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.176136 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 20:54:41.177852 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.176197 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-97.ec2.internal.18d41108ba7d5ce9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-97.ec2.internal,UID:ip-10-0-142-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-97.ec2.internal,},FirstTimestamp:2026-09-10 20:54:41.159118057 +0000 UTC m=+0.373673335,LastTimestamp:2026-09-10 20:54:41.159118057 +0000 UTC m=+0.373673335,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-97.ec2.internal,}" Sep 10 20:54:41.184662 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.184633 2563 manager.go:354] Recovery completed Sep 10 20:54:41.188881 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.188865 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 20:54:41.190844 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.190824 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientMemory" Sep 10 20:54:41.190923 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.190862 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 20:54:41.190923 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.190877 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientPID" Sep 10 20:54:41.191522 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.191506 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 20:54:41.191522 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.191519 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 20:54:41.191703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.191539 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 10 20:54:41.191703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.191520 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 20:54:41.192322 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.192305 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientMemory" Sep 10 20:54:41.192377 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.192335 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 20:54:41.192377 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.192350 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientPID" Sep 10 20:54:41.193674 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.193662 2563 policy_none.go:49] "None policy: Start" Sep 10 20:54:41.193716 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.193679 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 20:54:41.193716 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.193690 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 20:54:41.195596 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.195584 2563 policy_none.go:47] "Start" Sep 10 20:54:41.252314 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.252295 2563 manager.go:337] "Starting Device Plugin manager" Sep 10 20:54:41.252488 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.252341 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 20:54:41.252488 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.252355 2563 server.go:87] "Starting device plugin registration server" Sep 10 20:54:41.252845 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.252829 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 20:54:41.252928 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.252847 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 20:54:41.252988 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.252937 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 20:54:41.253118 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.253025 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 20:54:41.253118 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.253034 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 20:54:41.253648 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.253626 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 20:54:41.253736 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.253687 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.318411 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.318366 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 20:54:41.319692 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.319670 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 20:54:41.319831 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.319727 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 20:54:41.319831 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.319756 2563 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 20:54:41.319831 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.319808 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 20:54:41.321921 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.321902 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 20:54:41.353711 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.353608 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 20:54:41.355548 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.355532 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientMemory" Sep 10 20:54:41.355634 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.355584 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 20:54:41.355634 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.355598 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientPID" Sep 10 20:54:41.355634 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.355620 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.363902 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.363882 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.363955 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.363910 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-97.ec2.internal\": node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.373196 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.373172 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.420988 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.420331 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal"] Sep 10 20:54:41.421161 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.421031 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 20:54:41.422136 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.422115 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientMemory" Sep 10 20:54:41.422254 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.422154 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 20:54:41.422254 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.422168 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientPID" Sep 10 20:54:41.424604 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.424578 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 20:54:41.424708 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.424692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.424763 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.424734 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 20:54:41.425408 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.425390 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientMemory" Sep 10 20:54:41.425487 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.425422 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 20:54:41.425487 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.425432 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientPID" Sep 10 20:54:41.425487 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.425390 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientMemory" Sep 10 20:54:41.425636 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.425509 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 20:54:41.425636 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.425527 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientPID" Sep 10 20:54:41.427771 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.427756 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.427847 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.427786 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 20:54:41.428678 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.428657 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientMemory" Sep 10 20:54:41.428782 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.428691 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 20:54:41.428782 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.428705 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeHasSufficientPID" Sep 10 20:54:41.457519 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.457492 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-97.ec2.internal\" not found" node="ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.462122 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.462102 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-97.ec2.internal\" not found" node="ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.469685 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.469666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b9fca7460ebe5ee38042d670c8065ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal\" (UID: \"6b9fca7460ebe5ee38042d670c8065ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.469781 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.469692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b9fca7460ebe5ee38042d670c8065ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal\" (UID: \"6b9fca7460ebe5ee38042d670c8065ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.469781 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.469707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1e98489962299eff4ae2f4254cc6a1f1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-97.ec2.internal\" (UID: \"1e98489962299eff4ae2f4254cc6a1f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.473628 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.473599 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.569953 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.569912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b9fca7460ebe5ee38042d670c8065ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal\" (UID: \"6b9fca7460ebe5ee38042d670c8065ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.570128 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.569995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b9fca7460ebe5ee38042d670c8065ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal\" (UID: \"6b9fca7460ebe5ee38042d670c8065ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.570128 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.570020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1e98489962299eff4ae2f4254cc6a1f1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-97.ec2.internal\" (UID: \"1e98489962299eff4ae2f4254cc6a1f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.570128 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.570057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6b9fca7460ebe5ee38042d670c8065ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal\" (UID: \"6b9fca7460ebe5ee38042d670c8065ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.570128 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.570067 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1e98489962299eff4ae2f4254cc6a1f1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-97.ec2.internal\" (UID: \"1e98489962299eff4ae2f4254cc6a1f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.570128 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.570080 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b9fca7460ebe5ee38042d670c8065ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal\" (UID: \"6b9fca7460ebe5ee38042d670c8065ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.574020 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.574003 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.674923 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.674853 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.760074 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.760048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.765854 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:41.765175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" Sep 10 20:54:41.775112 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.775089 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.875675 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.875633 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:41.976301 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:41.976226 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:42.076973 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:42.076936 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:42.110045 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.110020 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 20:54:42.110445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.110170 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 20:54:42.175197 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.175158 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 20:49:41 +0000 UTC" deadline="2028-04-13 20:45:44.017914785 +0000 UTC" Sep 10 20:54:42.175197 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.175192 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13943h51m1.842727717s" Sep 10 20:54:42.177335 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:42.177314 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:42.277702 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:42.277668 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:42.363357 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.363324 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 20:54:42.379666 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:42.378496 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9fca7460ebe5ee38042d670c8065ca.slice/crio-f125699d9d5d39fe282b8a4ab60b94a232d7685aa17b5c75508333eb0c60843d WatchSource:0}: Error finding container f125699d9d5d39fe282b8a4ab60b94a232d7685aa17b5c75508333eb0c60843d: Status 404 returned error can't find the container with id f125699d9d5d39fe282b8a4ab60b94a232d7685aa17b5c75508333eb0c60843d Sep 10 20:54:42.379666 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:42.378619 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:42.383335 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.383311 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 20:54:42.445857 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.445824 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 20:54:42.479040 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:42.478972 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-97.ec2.internal\" not found" Sep 10 20:54:42.523704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.523680 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 20:54:42.569302 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.569273 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" Sep 10 20:54:42.579301 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.579285 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 20:54:42.580354 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.580336 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" Sep 10 20:54:42.591520 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:42.591497 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 20:54:43.149111 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.149075 2563 apiserver.go:52] "Watching apiserver" Sep 10 20:54:43.154730 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.154699 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 20:54:43.155175 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.155154 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-86jxv","kube-system/konnectivity-agent-7fqqt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz","openshift-network-diagnostics/network-check-target-s5kwb","openshift-network-operator/iptables-alerter-m48xg","openshift-ovn-kubernetes/ovnkube-node-pgbdq","kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal","openshift-cluster-node-tuning-operator/tuned-j927p","openshift-dns/node-resolver-4w2g6","openshift-image-registry/node-ca-ft759","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal","openshift-multus/multus-additional-cni-plugins-kl5dl","openshift-multus/multus-k9nd7","openshift-multus/network-metrics-daemon-w6zkl"] Sep 10 20:54:43.157685 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.157663 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.160079 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.159618 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tn4mp\"" Sep 10 20:54:43.160270 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.160248 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 20:54:43.160346 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.160278 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 20:54:43.161585 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.161551 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:43.161680 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.161632 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:43.163589 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.163553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.165803 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.165773 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m2mdl\"" Sep 10 20:54:43.165892 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.165801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:43.165892 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.165868 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:43.166148 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.166130 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 20:54:43.166148 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.166138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 20:54:43.166276 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.166161 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 20:54:43.167503 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.167485 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 20:54:43.168096 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.168079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.169991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.169971 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 20:54:43.170087 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.169979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 20:54:43.170162 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.170139 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 20:54:43.170266 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.170176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2wgh4\"" Sep 10 20:54:43.170737 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.170720 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.172851 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.172830 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 20:54:43.173277 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.173257 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 20:54:43.173359 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.173280 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 20:54:43.173424 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.173393 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ktz2s\"" Sep 10 20:54:43.173513 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.173481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.173621 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.173524 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 20:54:43.173621 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.173536 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 20:54:43.173753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.173486 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 20:54:43.175259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.175240 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.175732 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.175712 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 20:54:43.176059 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.176038 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 20:54:43.176132 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.176082 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 20:54:43.176186 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.176158 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 20:54:43.176186 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.176040 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 20:54:43.176324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.176304 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pkzxc\"" Sep 10 20:54:43.177457 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177318 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 20:54:43.177457 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177350 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sfzlm\"" Sep 10 20:54:43.177457 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-sys-fs\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.177457 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a261123-3ff1-4cd9-b17e-073352b72a75-tmp-dir\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.177711 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:43.177711 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-device-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.177711 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-log-socket\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177711 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177659 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 20:54:43.177711 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-cni-netd\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovn-node-metrics-cert\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mksl\" (UniqueName: \"kubernetes.io/projected/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-kube-api-access-9mksl\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177794 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-systemd-units\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-var-lib-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-node-log\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-cni-bin\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177906 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177936 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.177975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-env-overrides\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.177995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a261123-3ff1-4cd9-b17e-073352b72a75-hosts-file\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zwvx\" (UniqueName: \"kubernetes.io/projected/7a261123-3ff1-4cd9-b17e-073352b72a75-kube-api-access-6zwvx\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-iptables-alerter-script\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovnkube-script-lib\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rxr9\" (UniqueName: \"kubernetes.io/projected/933b4eae-c038-460e-8ea7-bddfcdd99f60-kube-api-access-8rxr9\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-host-slash\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-run-netns\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbf2j\" (UniqueName: \"kubernetes.io/projected/66457e77-df34-409b-bc16-ee9319a2de38-kube-api-access-kbf2j\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-systemd\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovnkube-config\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhqqw\" (UniqueName: \"kubernetes.io/projected/07e3e1cd-c9a0-486e-a643-107f091b81ed-kube-api-access-qhqqw\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-etc-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-ovn\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.178447 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-etc-selinux\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.179204 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-registration-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.179204 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-kubelet\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.179204 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-socket-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.179204 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-slash\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.179204 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.178593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.179429 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.179416 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 20:54:43.180600 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.179975 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 20:54:43.180600 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.179986 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 20:54:43.180600 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.180223 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mbpjm\"" Sep 10 20:54:43.180600 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.180322 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 20:54:43.180600 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.180477 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.180600 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.180537 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:43.183360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.182763 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.184759 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.184738 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 20:54:43.184864 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.184840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5lz4p\"" Sep 10 20:54:43.185296 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.185276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.187320 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.187297 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 20:54:43.187422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.187353 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m6gpt\"" Sep 10 20:54:43.187546 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.187433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 20:54:43.220001 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.219968 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6cx8n" Sep 10 20:54:43.227948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.227923 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6cx8n" Sep 10 20:54:43.270040 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.270009 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 20:54:43.279462 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-slash\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.279462 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysctl-conf\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-host\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279591 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-slash\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-sys-fs\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279628 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-device-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-log-socket\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.279742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-cni-netd\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovn-node-metrics-cert\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279756 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-sys-fs\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c-agent-certs\") pod \"konnectivity-agent-7fqqt\" (UID: \"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c\") " pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-log-socket\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysctl-d\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-systemd-units\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279850 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-device-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-cni-bin\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-env-overrides\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.279758 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cea5094b-f793-41e4-9177-f3daba3c0e1b-serviceca\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cb35164-6807-49ec-a04c-ec048af380b8-cni-binary-copy\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-conf-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.279997 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs podName:933b4eae-c038-460e-8ea7-bddfcdd99f60 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:43.779956316 +0000 UTC m=+2.994511603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs") pod "network-metrics-daemon-w6zkl" (UID: "933b4eae-c038-460e-8ea7-bddfcdd99f60") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280021 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-systemd-units\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280070 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-cni-bin\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-var-lib-kubelet\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2bmb\" (UniqueName: \"kubernetes.io/projected/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-kube-api-access-p2bmb\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovnkube-script-lib\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cea5094b-f793-41e4-9177-f3daba3c0e1b-host\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkc5k\" (UniqueName: \"kubernetes.io/projected/9cb35164-6807-49ec-a04c-ec048af380b8-kube-api-access-gkc5k\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9gwz\" (UniqueName: \"kubernetes.io/projected/026cbc27-4f88-49b1-855a-7fed14f763ca-kube-api-access-b9gwz\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-modprobe-d\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-tmp\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-host-slash\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-run-netns\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbf2j\" (UniqueName: \"kubernetes.io/projected/66457e77-df34-409b-bc16-ee9319a2de38-kube-api-access-kbf2j\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-systemd\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovnkube-config\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c-konnectivity-ca\") pod \"konnectivity-agent-7fqqt\" (UID: \"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c\") " pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-cnibin\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.280999 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280513 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280515 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-host-slash\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.279891 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-cni-netd\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-tuned\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280622 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-env-overrides\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-socket-dir-parent\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-etc-selinux\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280702 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-run-netns\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-registration-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280754 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-registration-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-kubelet\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-cni-bin\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280832 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-systemd\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-hostroot\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-kubernetes\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280863 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-kubelet\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.281699 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280940 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-etc-selinux\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3380d104-eb93-44ee-be7d-9ef83e8737c1-kubelet-config\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280971 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovnkube-script-lib\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.280997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-socket-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-lib-modules\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a261123-3ff1-4cd9-b17e-073352b72a75-tmp-dir\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm4ck\" (UniqueName: \"kubernetes.io/projected/cea5094b-f793-41e4-9177-f3daba3c0e1b-kube-api-access-nm4ck\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-cni-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-systemd\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-socket-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cb35164-6807-49ec-a04c-ec048af380b8-multus-daemon-config\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mksl\" (UniqueName: \"kubernetes.io/projected/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-kube-api-access-9mksl\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281314 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a261123-3ff1-4cd9-b17e-073352b72a75-tmp-dir\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-var-lib-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-node-log\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.282454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-var-lib-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-cni-multus\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281446 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281453 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-node-log\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a261123-3ff1-4cd9-b17e-073352b72a75-hosts-file\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zwvx\" (UniqueName: \"kubernetes.io/projected/7a261123-3ff1-4cd9-b17e-073352b72a75-kube-api-access-6zwvx\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-iptables-alerter-script\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281602 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a261123-3ff1-4cd9-b17e-073352b72a75-hosts-file\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-kubelet\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-multus-certs\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rxr9\" (UniqueName: \"kubernetes.io/projected/933b4eae-c038-460e-8ea7-bddfcdd99f60-kube-api-access-8rxr9\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-system-cni-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-netns\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysconfig\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-run\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.283168 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281855 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281962 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhqqw\" (UniqueName: \"kubernetes.io/projected/07e3e1cd-c9a0-486e-a643-107f091b81ed-kube-api-access-qhqqw\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281962 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovnkube-config\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.281999 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66457e77-df34-409b-bc16-ee9319a2de38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-k8s-cni-cncf-io\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282097 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-iptables-alerter-script\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-etc-kubernetes\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-sys\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3380d104-eb93-44ee-be7d-9ef83e8737c1-dbus\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-etc-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-ovn\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-cnibin\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-system-cni-dir\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282422 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-etc-openvswitch\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.283948 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.282442 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07e3e1cd-c9a0-486e-a643-107f091b81ed-run-ovn\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.285092 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.285069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07e3e1cd-c9a0-486e-a643-107f091b81ed-ovn-node-metrics-cert\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.288293 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.288263 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 20:54:43.288293 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.288289 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 20:54:43.288432 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.288303 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lbnbh for pod openshift-network-diagnostics/network-check-target-s5kwb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:43.288432 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.288369 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh podName:06855ecc-d7cb-4421-acf4-ffb6543dbc6e nodeName:}" failed. No retries permitted until 2026-09-10 20:54:43.788350138 +0000 UTC m=+3.002905409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lbnbh" (UniqueName: "kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh") pod "network-check-target-s5kwb" (UID: "06855ecc-d7cb-4421-acf4-ffb6543dbc6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:43.289906 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.289872 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbf2j\" (UniqueName: \"kubernetes.io/projected/66457e77-df34-409b-bc16-ee9319a2de38-kube-api-access-kbf2j\") pod \"aws-ebs-csi-driver-node-f6xjz\" (UID: \"66457e77-df34-409b-bc16-ee9319a2de38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.290748 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.290724 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mksl\" (UniqueName: \"kubernetes.io/projected/9fb7f6da-af74-4a3b-ac7c-50efa8f85665-kube-api-access-9mksl\") pod \"iptables-alerter-m48xg\" (UID: \"9fb7f6da-af74-4a3b-ac7c-50efa8f85665\") " pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.290985 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.290963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhqqw\" (UniqueName: \"kubernetes.io/projected/07e3e1cd-c9a0-486e-a643-107f091b81ed-kube-api-access-qhqqw\") pod \"ovnkube-node-pgbdq\" (UID: \"07e3e1cd-c9a0-486e-a643-107f091b81ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.291086 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.291069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zwvx\" (UniqueName: \"kubernetes.io/projected/7a261123-3ff1-4cd9-b17e-073352b72a75-kube-api-access-6zwvx\") pod \"node-resolver-4w2g6\" (UID: \"7a261123-3ff1-4cd9-b17e-073352b72a75\") " pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.292032 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.292013 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rxr9\" (UniqueName: \"kubernetes.io/projected/933b4eae-c038-460e-8ea7-bddfcdd99f60-kube-api-access-8rxr9\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:43.326797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.324520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" event={"ID":"6b9fca7460ebe5ee38042d670c8065ca","Type":"ContainerStarted","Data":"f125699d9d5d39fe282b8a4ab60b94a232d7685aa17b5c75508333eb0c60843d"} Sep 10 20:54:43.327768 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.327724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" event={"ID":"1e98489962299eff4ae2f4254cc6a1f1","Type":"ContainerStarted","Data":"c561259babe313574adff3420e6e845624a779ad0a5572cf86309db329d081ae"} Sep 10 20:54:43.383727 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysconfig\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.383727 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-run\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-k8s-cni-cncf-io\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-etc-kubernetes\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383822 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysconfig\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-sys\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383874 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-sys\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3380d104-eb93-44ee-be7d-9ef83e8737c1-dbus\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-cnibin\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383918 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-run\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.383933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-system-cni-dir\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.383982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysctl-conf\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-host\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.384011 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c-agent-certs\") pod \"konnectivity-agent-7fqqt\" (UID: \"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c\") " pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.384068 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret podName:3380d104-eb93-44ee-be7d-9ef83e8737c1 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:43.884050391 +0000 UTC m=+3.098605658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret") pod "global-pull-secret-syncer-86jxv" (UID: "3380d104-eb93-44ee-be7d-9ef83e8737c1") : object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysctl-d\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cea5094b-f793-41e4-9177-f3daba3c0e1b-serviceca\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cb35164-6807-49ec-a04c-ec048af380b8-cni-binary-copy\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-conf-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-var-lib-kubelet\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2bmb\" (UniqueName: \"kubernetes.io/projected/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-kube-api-access-p2bmb\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cea5094b-f793-41e4-9177-f3daba3c0e1b-host\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkc5k\" (UniqueName: \"kubernetes.io/projected/9cb35164-6807-49ec-a04c-ec048af380b8-kube-api-access-gkc5k\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.384280 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9gwz\" (UniqueName: \"kubernetes.io/projected/026cbc27-4f88-49b1-855a-7fed14f763ca-kube-api-access-b9gwz\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-modprobe-d\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-tmp\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c-konnectivity-ca\") pod \"konnectivity-agent-7fqqt\" (UID: \"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c\") " pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-cnibin\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-tuned\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-socket-dir-parent\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-cni-bin\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-hostroot\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384492 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3380d104-eb93-44ee-be7d-9ef83e8737c1-dbus\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-kubernetes\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3380d104-eb93-44ee-be7d-9ef83e8737c1-kubelet-config\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384589 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-cnibin\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-lib-modules\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm4ck\" (UniqueName: \"kubernetes.io/projected/cea5094b-f793-41e4-9177-f3daba3c0e1b-kube-api-access-nm4ck\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.384977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384638 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-system-cni-dir\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-cni-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-systemd\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cb35164-6807-49ec-a04c-ec048af380b8-multus-daemon-config\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-cni-multus\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-kubelet\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-multus-certs\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-system-cni-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-netns\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384932 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-kubernetes\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.384973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-netns\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385007 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-cnibin\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385018 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-k8s-cni-cncf-io\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385039 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-cni-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385078 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-etc-kubernetes\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-systemd\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385220 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.385842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385265 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysctl-d\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385295 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-host\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385299 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c-konnectivity-ca\") pod \"konnectivity-agent-7fqqt\" (UID: \"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c\") " pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385334 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-lib-modules\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385350 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-hostroot\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385376 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-conf-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385419 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-sysctl-conf\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385465 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3380d104-eb93-44ee-be7d-9ef83e8737c1-kubelet-config\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cea5094b-f793-41e4-9177-f3daba3c0e1b-host\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385641 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9cb35164-6807-49ec-a04c-ec048af380b8-multus-daemon-config\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-cni-multus\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-modprobe-d\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385723 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cea5094b-f793-41e4-9177-f3daba3c0e1b-serviceca\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385727 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-kubelet\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385749 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-run-multus-certs\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385757 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-system-cni-dir\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-var-lib-kubelet\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.386615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385814 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-multus-socket-dir-parent\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.387503 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385854 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9cb35164-6807-49ec-a04c-ec048af380b8-host-var-lib-cni-bin\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.387503 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.385908 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/026cbc27-4f88-49b1-855a-7fed14f763ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.387503 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.386197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cb35164-6807-49ec-a04c-ec048af380b8-cni-binary-copy\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.387503 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.386295 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/026cbc27-4f88-49b1-855a-7fed14f763ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.388970 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.388757 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-etc-tuned\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.388970 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.388783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c-agent-certs\") pod \"konnectivity-agent-7fqqt\" (UID: \"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c\") " pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.388970 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.388839 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-tmp\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.395555 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.395522 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9gwz\" (UniqueName: \"kubernetes.io/projected/026cbc27-4f88-49b1-855a-7fed14f763ca-kube-api-access-b9gwz\") pod \"multus-additional-cni-plugins-kl5dl\" (UID: \"026cbc27-4f88-49b1-855a-7fed14f763ca\") " pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.395707 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.395695 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm4ck\" (UniqueName: \"kubernetes.io/projected/cea5094b-f793-41e4-9177-f3daba3c0e1b-kube-api-access-nm4ck\") pod \"node-ca-ft759\" (UID: \"cea5094b-f793-41e4-9177-f3daba3c0e1b\") " pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.396551 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.396524 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkc5k\" (UniqueName: \"kubernetes.io/projected/9cb35164-6807-49ec-a04c-ec048af380b8-kube-api-access-gkc5k\") pod \"multus-k9nd7\" (UID: \"9cb35164-6807-49ec-a04c-ec048af380b8\") " pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.398144 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.398120 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2bmb\" (UniqueName: \"kubernetes.io/projected/ed83f3d4-b5cf-4345-8de5-1d04b42311fc-kube-api-access-p2bmb\") pod \"tuned-j927p\" (UID: \"ed83f3d4-b5cf-4345-8de5-1d04b42311fc\") " pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.468997 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.468916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4w2g6" Sep 10 20:54:43.476713 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.476689 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" Sep 10 20:54:43.486545 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.486519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m48xg" Sep 10 20:54:43.494384 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.494347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:54:43.501056 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.501033 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" Sep 10 20:54:43.508681 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.508660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j927p" Sep 10 20:54:43.516246 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.516225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ft759" Sep 10 20:54:43.525976 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.525953 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9nd7" Sep 10 20:54:43.530740 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.530721 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:54:43.593171 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.592947 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 20:54:43.788975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.788875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:43.788975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.788960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:43.789173 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.789081 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 20:54:43.789173 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.789097 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:43.789173 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.789103 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 20:54:43.789173 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.789117 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lbnbh for pod openshift-network-diagnostics/network-check-target-s5kwb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:43.789173 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.789167 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh podName:06855ecc-d7cb-4421-acf4-ffb6543dbc6e nodeName:}" failed. No retries permitted until 2026-09-10 20:54:44.789148216 +0000 UTC m=+4.003703500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbnbh" (UniqueName: "kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh") pod "network-check-target-s5kwb" (UID: "06855ecc-d7cb-4421-acf4-ffb6543dbc6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:43.789412 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.789186 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs podName:933b4eae-c038-460e-8ea7-bddfcdd99f60 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:44.789177249 +0000 UTC m=+4.003732524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs") pod "network-metrics-daemon-w6zkl" (UID: "933b4eae-c038-460e-8ea7-bddfcdd99f60") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:43.890254 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:43.890214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:43.890459 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.890409 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:43.890510 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:43.890492 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret podName:3380d104-eb93-44ee-be7d-9ef83e8737c1 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:44.890468384 +0000 UTC m=+4.105023656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret") pod "global-pull-secret-syncer-86jxv" (UID: "3380d104-eb93-44ee-be7d-9ef83e8737c1") : object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:44.231530 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:44.231442 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:49:43 +0000 UTC" deadline="2028-03-13 04:25:11.031882602 +0000 UTC" Sep 10 20:54:44.231530 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:44.231478 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13183h30m26.8004076s" Sep 10 20:54:44.320834 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:44.320803 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:44.320998 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:44.320803 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:44.320998 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.320941 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:44.320998 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.320982 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:44.411942 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.411909 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce2b4ea_73dd_42d4_8589_0b7fe5498f3c.slice/crio-43b92a0a61ae90ecf10af893d14f197999a6415c078b819cfc7240b9c39e36f2 WatchSource:0}: Error finding container 43b92a0a61ae90ecf10af893d14f197999a6415c078b819cfc7240b9c39e36f2: Status 404 returned error can't find the container with id 43b92a0a61ae90ecf10af893d14f197999a6415c078b819cfc7240b9c39e36f2 Sep 10 20:54:44.413022 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.412991 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea5094b_f793_41e4_9177_f3daba3c0e1b.slice/crio-5571bd86331b6099465cd0fcbe53398f828dfc25cc7c2bd4094846366263fd0f WatchSource:0}: Error finding container 5571bd86331b6099465cd0fcbe53398f828dfc25cc7c2bd4094846366263fd0f: Status 404 returned error can't find the container with id 5571bd86331b6099465cd0fcbe53398f828dfc25cc7c2bd4094846366263fd0f Sep 10 20:54:44.414423 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.414390 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66457e77_df34_409b_bc16_ee9319a2de38.slice/crio-32d16be06f0d79d2bc924202e60d829c5cff7e14dd83b515ff15216b792e7943 WatchSource:0}: Error finding container 32d16be06f0d79d2bc924202e60d829c5cff7e14dd83b515ff15216b792e7943: Status 404 returned error can't find the container with id 32d16be06f0d79d2bc924202e60d829c5cff7e14dd83b515ff15216b792e7943 Sep 10 20:54:44.415819 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.415716 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a261123_3ff1_4cd9_b17e_073352b72a75.slice/crio-acd97b88eed84ff759c2020a5e3fd655b92b2f9d6dd4a6d371aac1c43daf7a8d WatchSource:0}: Error finding container acd97b88eed84ff759c2020a5e3fd655b92b2f9d6dd4a6d371aac1c43daf7a8d: Status 404 returned error can't find the container with id acd97b88eed84ff759c2020a5e3fd655b92b2f9d6dd4a6d371aac1c43daf7a8d Sep 10 20:54:44.420028 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.420002 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e3e1cd_c9a0_486e_a643_107f091b81ed.slice/crio-85ac4c77bb8821bb8d23f84d4201705625927cf93e5d32db29e272e0d1446bab WatchSource:0}: Error finding container 85ac4c77bb8821bb8d23f84d4201705625927cf93e5d32db29e272e0d1446bab: Status 404 returned error can't find the container with id 85ac4c77bb8821bb8d23f84d4201705625927cf93e5d32db29e272e0d1446bab Sep 10 20:54:44.421702 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.421670 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb7f6da_af74_4a3b_ac7c_50efa8f85665.slice/crio-671ab22d2ac7a29309cac1bffe29f15a23134b2085bf764d70d3aada0abdde27 WatchSource:0}: Error finding container 671ab22d2ac7a29309cac1bffe29f15a23134b2085bf764d70d3aada0abdde27: Status 404 returned error can't find the container with id 671ab22d2ac7a29309cac1bffe29f15a23134b2085bf764d70d3aada0abdde27 Sep 10 20:54:44.423216 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.423192 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded83f3d4_b5cf_4345_8de5_1d04b42311fc.slice/crio-3ee3014c59e96ecde3bdc68ee4618c9b81e5cee467593fd7ea89b3ad909afe49 WatchSource:0}: Error finding container 3ee3014c59e96ecde3bdc68ee4618c9b81e5cee467593fd7ea89b3ad909afe49: Status 404 returned error can't find the container with id 3ee3014c59e96ecde3bdc68ee4618c9b81e5cee467593fd7ea89b3ad909afe49 Sep 10 20:54:44.425712 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.424866 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026cbc27_4f88_49b1_855a_7fed14f763ca.slice/crio-af88a00ef29a009f635ebb5856813b019f8828cfdeb3993f4d9088a39b50992a WatchSource:0}: Error finding container af88a00ef29a009f635ebb5856813b019f8828cfdeb3993f4d9088a39b50992a: Status 404 returned error can't find the container with id af88a00ef29a009f635ebb5856813b019f8828cfdeb3993f4d9088a39b50992a Sep 10 20:54:44.426079 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:54:44.426052 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb35164_6807_49ec_a04c_ec048af380b8.slice/crio-ce98de9d1b8d6a9c385da581c6b0bf9568638631dea71f8cb6eacc3156f7b1c1 WatchSource:0}: Error finding container ce98de9d1b8d6a9c385da581c6b0bf9568638631dea71f8cb6eacc3156f7b1c1: Status 404 returned error can't find the container with id ce98de9d1b8d6a9c385da581c6b0bf9568638631dea71f8cb6eacc3156f7b1c1 Sep 10 20:54:44.799027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:44.798930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:44.799027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:44.798986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:44.799213 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.799096 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:44.799213 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.799115 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 20:54:44.799213 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.799139 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 20:54:44.799213 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.799151 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs podName:933b4eae-c038-460e-8ea7-bddfcdd99f60 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:46.799136974 +0000 UTC m=+6.013692242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs") pod "network-metrics-daemon-w6zkl" (UID: "933b4eae-c038-460e-8ea7-bddfcdd99f60") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:44.799213 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.799153 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lbnbh for pod openshift-network-diagnostics/network-check-target-s5kwb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:44.799386 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.799221 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh podName:06855ecc-d7cb-4421-acf4-ffb6543dbc6e nodeName:}" failed. No retries permitted until 2026-09-10 20:54:46.799206606 +0000 UTC m=+6.013761879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbnbh" (UniqueName: "kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh") pod "network-check-target-s5kwb" (UID: "06855ecc-d7cb-4421-acf4-ffb6543dbc6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:44.899322 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:44.899281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:44.899987 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.899531 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:44.899987 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:44.899622 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret podName:3380d104-eb93-44ee-be7d-9ef83e8737c1 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:46.899584151 +0000 UTC m=+6.114139419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret") pod "global-pull-secret-syncer-86jxv" (UID: "3380d104-eb93-44ee-be7d-9ef83e8737c1") : object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:45.234767 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.234581 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:49:43 +0000 UTC" deadline="2028-04-16 07:04:23.700790931 +0000 UTC" Sep 10 20:54:45.234767 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.234626 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14002h9m38.466170576s" Sep 10 20:54:45.321808 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.321774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:45.322004 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:45.321923 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:45.361297 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.361253 2563 generic.go:356] "Generic (PLEG): container finished" podID="6b9fca7460ebe5ee38042d670c8065ca" containerID="fbaa5023b0259e24441bf82ecd5f9ad2c13b6ba79c61012dedf04c5418ff9fa8" exitCode=0 Sep 10 20:54:45.361490 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.361355 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" event={"ID":"6b9fca7460ebe5ee38042d670c8065ca","Type":"ContainerDied","Data":"fbaa5023b0259e24441bf82ecd5f9ad2c13b6ba79c61012dedf04c5418ff9fa8"} Sep 10 20:54:45.385186 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.385151 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m48xg" event={"ID":"9fb7f6da-af74-4a3b-ac7c-50efa8f85665","Type":"ContainerStarted","Data":"671ab22d2ac7a29309cac1bffe29f15a23134b2085bf764d70d3aada0abdde27"} Sep 10 20:54:45.402031 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.401982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j927p" event={"ID":"ed83f3d4-b5cf-4345-8de5-1d04b42311fc","Type":"ContainerStarted","Data":"3ee3014c59e96ecde3bdc68ee4618c9b81e5cee467593fd7ea89b3ad909afe49"} Sep 10 20:54:45.415007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.414972 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4w2g6" event={"ID":"7a261123-3ff1-4cd9-b17e-073352b72a75","Type":"ContainerStarted","Data":"acd97b88eed84ff759c2020a5e3fd655b92b2f9d6dd4a6d371aac1c43daf7a8d"} Sep 10 20:54:45.421361 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.421317 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fqqt" event={"ID":"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c","Type":"ContainerStarted","Data":"43b92a0a61ae90ecf10af893d14f197999a6415c078b819cfc7240b9c39e36f2"} Sep 10 20:54:45.430374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.430339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" event={"ID":"1e98489962299eff4ae2f4254cc6a1f1","Type":"ContainerStarted","Data":"340e62041c89d77b77da7b002e7242b82323cee6ab1ad742b7820d86c3de4239"} Sep 10 20:54:45.443387 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.443351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9nd7" event={"ID":"9cb35164-6807-49ec-a04c-ec048af380b8","Type":"ContainerStarted","Data":"ce98de9d1b8d6a9c385da581c6b0bf9568638631dea71f8cb6eacc3156f7b1c1"} Sep 10 20:54:45.444472 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.444407 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-97.ec2.internal" podStartSLOduration=2.444387537 podStartE2EDuration="2.444387537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:54:45.443797841 +0000 UTC m=+4.658353134" watchObservedRunningTime="2026-09-10 20:54:45.444387537 +0000 UTC m=+4.658942831" Sep 10 20:54:45.462767 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.462698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerStarted","Data":"af88a00ef29a009f635ebb5856813b019f8828cfdeb3993f4d9088a39b50992a"} Sep 10 20:54:45.479413 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.479306 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"85ac4c77bb8821bb8d23f84d4201705625927cf93e5d32db29e272e0d1446bab"} Sep 10 20:54:45.492377 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.492121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" event={"ID":"66457e77-df34-409b-bc16-ee9319a2de38","Type":"ContainerStarted","Data":"32d16be06f0d79d2bc924202e60d829c5cff7e14dd83b515ff15216b792e7943"} Sep 10 20:54:45.503703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:45.503653 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ft759" event={"ID":"cea5094b-f793-41e4-9177-f3daba3c0e1b","Type":"ContainerStarted","Data":"5571bd86331b6099465cd0fcbe53398f828dfc25cc7c2bd4094846366263fd0f"} Sep 10 20:54:46.320383 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:46.320334 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:46.321071 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.320488 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:46.321071 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:46.320957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:46.321071 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.321054 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:46.536747 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:46.536697 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" event={"ID":"6b9fca7460ebe5ee38042d670c8065ca","Type":"ContainerStarted","Data":"bb0bd66904ddc65dda959bc0a4714454c2904da3f54fea5f92e87759a68def9c"} Sep 10 20:54:46.553838 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:46.553769 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-97.ec2.internal" podStartSLOduration=3.553743979 podStartE2EDuration="3.553743979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:54:46.552946443 +0000 UTC m=+5.767501736" watchObservedRunningTime="2026-09-10 20:54:46.553743979 +0000 UTC m=+5.768299270" Sep 10 20:54:46.814989 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:46.814889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:46.815160 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:46.814988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:46.815160 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.815147 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 20:54:46.815267 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.815169 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 20:54:46.815267 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.815183 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lbnbh for pod openshift-network-diagnostics/network-check-target-s5kwb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:46.815267 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.815247 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh podName:06855ecc-d7cb-4421-acf4-ffb6543dbc6e nodeName:}" failed. No retries permitted until 2026-09-10 20:54:50.815228905 +0000 UTC m=+10.029784176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbnbh" (UniqueName: "kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh") pod "network-check-target-s5kwb" (UID: "06855ecc-d7cb-4421-acf4-ffb6543dbc6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:46.815715 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.815694 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:46.815809 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.815757 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs podName:933b4eae-c038-460e-8ea7-bddfcdd99f60 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:50.815739079 +0000 UTC m=+10.030294352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs") pod "network-metrics-daemon-w6zkl" (UID: "933b4eae-c038-460e-8ea7-bddfcdd99f60") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:46.915381 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:46.915341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:46.915566 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.915531 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:46.915666 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:46.915600 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret podName:3380d104-eb93-44ee-be7d-9ef83e8737c1 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:50.915580145 +0000 UTC m=+10.130135419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret") pod "global-pull-secret-syncer-86jxv" (UID: "3380d104-eb93-44ee-be7d-9ef83e8737c1") : object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:47.323376 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:47.322741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:47.323376 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:47.322899 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:48.320619 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:48.320567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:48.320823 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:48.320567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:48.320823 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:48.320737 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:48.320823 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:48.320765 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:49.321574 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:49.321508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:49.326185 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:49.322814 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:50.321116 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:50.321001 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:50.321116 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:50.321057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:50.321353 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.321150 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:50.321353 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.321302 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:50.848059 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:50.848017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:50.848485 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:50.848097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:50.848485 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.848218 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:50.848485 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.848240 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 20:54:50.848485 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.848261 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 20:54:50.848485 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.848274 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lbnbh for pod openshift-network-diagnostics/network-check-target-s5kwb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:50.848485 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.848283 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs podName:933b4eae-c038-460e-8ea7-bddfcdd99f60 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:58.848264399 +0000 UTC m=+18.062819687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs") pod "network-metrics-daemon-w6zkl" (UID: "933b4eae-c038-460e-8ea7-bddfcdd99f60") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:50.848485 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.848310 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh podName:06855ecc-d7cb-4421-acf4-ffb6543dbc6e nodeName:}" failed. No retries permitted until 2026-09-10 20:54:58.848299804 +0000 UTC m=+18.062855089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbnbh" (UniqueName: "kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh") pod "network-check-target-s5kwb" (UID: "06855ecc-d7cb-4421-acf4-ffb6543dbc6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:50.949920 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:50.949293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:50.949920 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.949485 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:50.949920 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:50.949557 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret podName:3380d104-eb93-44ee-be7d-9ef83e8737c1 nodeName:}" failed. No retries permitted until 2026-09-10 20:54:58.949536289 +0000 UTC m=+18.164091568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret") pod "global-pull-secret-syncer-86jxv" (UID: "3380d104-eb93-44ee-be7d-9ef83e8737c1") : object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:51.321443 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:51.321340 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:51.321631 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:51.321470 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:52.320764 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:52.320729 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:52.321392 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:52.320863 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:52.321392 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:52.320911 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:52.321392 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:52.321023 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:53.320488 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:53.320329 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:53.320488 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:53.320487 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:54.320399 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:54.320351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:54.320837 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:54.320351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:54.320837 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:54.320488 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:54.320837 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:54.320540 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:55.320713 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:55.320682 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:55.321068 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:55.320802 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:56.320751 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:56.320715 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:56.321215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:56.320714 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:56.321215 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:56.320862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:56.321215 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:56.320909 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:57.320979 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:57.320944 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:57.321395 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:57.321082 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:54:58.320716 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:58.320678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:58.320924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:58.320684 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:58.320924 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.320800 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:54:58.320924 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.320855 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:54:58.911174 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:58.911130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:58.911382 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:58.911236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:54:58.911382 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.911267 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:58.911382 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.911346 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs podName:933b4eae-c038-460e-8ea7-bddfcdd99f60 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:14.91132481 +0000 UTC m=+34.125880081 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs") pod "network-metrics-daemon-w6zkl" (UID: "933b4eae-c038-460e-8ea7-bddfcdd99f60") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:54:58.911587 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.911392 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 20:54:58.911587 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.911412 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 20:54:58.911587 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.911426 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lbnbh for pod openshift-network-diagnostics/network-check-target-s5kwb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:58.911587 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:58.911479 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh podName:06855ecc-d7cb-4421-acf4-ffb6543dbc6e nodeName:}" failed. No retries permitted until 2026-09-10 20:55:14.911462703 +0000 UTC m=+34.126017969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbnbh" (UniqueName: "kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh") pod "network-check-target-s5kwb" (UID: "06855ecc-d7cb-4421-acf4-ffb6543dbc6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:54:59.012022 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:59.011990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:54:59.012196 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:59.012139 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:59.012253 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:59.012197 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret podName:3380d104-eb93-44ee-be7d-9ef83e8737c1 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:15.012181921 +0000 UTC m=+34.226737203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret") pod "global-pull-secret-syncer-86jxv" (UID: "3380d104-eb93-44ee-be7d-9ef83e8737c1") : object "kube-system"/"original-pull-secret" not registered Sep 10 20:54:59.320423 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:54:59.320391 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:54:59.320608 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:54:59.320533 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:00.320843 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:00.320807 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:00.321275 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:00.320807 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:00.321275 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:00.320917 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:00.321275 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:00.321014 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:01.321129 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:01.321089 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:01.321548 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:01.321229 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:02.320703 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:02.320661 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:02.320876 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:02.320660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:02.320876 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:02.320812 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:02.320981 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:02.320894 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:03.324313 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.324134 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:03.325182 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:03.324404 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:03.578117 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.578079 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9nd7" event={"ID":"9cb35164-6807-49ec-a04c-ec048af380b8","Type":"ContainerStarted","Data":"d7e54337c19daca7eac2f9c2c1227eee0f7b4a0794233ba7dd83a8841dd96b6d"} Sep 10 20:55:03.580080 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.580051 2563 generic.go:356] "Generic (PLEG): container finished" podID="026cbc27-4f88-49b1-855a-7fed14f763ca" containerID="95b1bfdef4e474ddf31034b50fb3b0c75ebe874cff36d96bcd07b47f83c8ab06" exitCode=0 Sep 10 20:55:03.580217 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.580129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerDied","Data":"95b1bfdef4e474ddf31034b50fb3b0c75ebe874cff36d96bcd07b47f83c8ab06"} Sep 10 20:55:03.584017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.583944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"23b33fd1caef9e5537bd5f1acb8d0a56b1375a7f83cad947aea0198082a9d981"} Sep 10 20:55:03.584134 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.584019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"7f860cf3a35be359996310cc3769e6bf3d32d0202440cbe2eb1b50ab8d8340da"} Sep 10 20:55:03.584134 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.584070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"feb62e32b8f633a579e1c36ebd77bc8d5c1af48b85b7af255b5673893f5144d0"} Sep 10 20:55:03.584134 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.584116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"ef3af03659db258a34caa1180c3e9bca506c68159747c57975b0acf4f16f5134"} Sep 10 20:55:03.584285 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.584163 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"68c0d4d023f94ffbd3f5d8fca9f3c6e86a1511060969a8c727e56820c9360fdc"} Sep 10 20:55:03.584285 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.584213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"ebd3ca0d74e5a5959a57898828710cb948f59149b73fe10a73aaaac69a58f6d9"} Sep 10 20:55:03.585842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.585814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" event={"ID":"66457e77-df34-409b-bc16-ee9319a2de38","Type":"ContainerStarted","Data":"484a1b0424a0ba26800f1239df731bb2e4fd332bb5a4571b29c424a5843ff25f"} Sep 10 20:55:03.587457 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.587435 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ft759" event={"ID":"cea5094b-f793-41e4-9177-f3daba3c0e1b","Type":"ContainerStarted","Data":"88ab4b1325130b10631cb6e8e247523d4e54d6a8fb5f4b9f82b052d5bced64f2"} Sep 10 20:55:03.589062 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.589032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j927p" event={"ID":"ed83f3d4-b5cf-4345-8de5-1d04b42311fc","Type":"ContainerStarted","Data":"c3f5fe9a3ad8834f2231fa842ebdf044a8a7938f25ce71ba5d1752af45a213a9"} Sep 10 20:55:03.590663 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.590639 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4w2g6" event={"ID":"7a261123-3ff1-4cd9-b17e-073352b72a75","Type":"ContainerStarted","Data":"841a7620c2cf7604576b3796e6e7f6c504dc6883fed86bc14edec86f447e9d09"} Sep 10 20:55:03.592208 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.592186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fqqt" event={"ID":"1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c","Type":"ContainerStarted","Data":"4631b0d107ebc87fc4ebd8950543759cec56c4c5fb0b13f1ac4308d72794344a"} Sep 10 20:55:03.599500 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.599444 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k9nd7" podStartSLOduration=3.374825684 podStartE2EDuration="21.599421777s" totalImagesPullingTime="18.224596093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:03.598046212 +0000 UTC m=+22.812601502" watchObservedRunningTime="2026-09-10 20:55:03.599421777 +0000 UTC m=+22.813977067" Sep 10 20:55:03.616954 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.616866 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j927p" podStartSLOduration=4.421202025 podStartE2EDuration="22.616847809s" totalImagesPullingTime="18.195645784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:03.61678564 +0000 UTC m=+22.831340939" watchObservedRunningTime="2026-09-10 20:55:03.616847809 +0000 UTC m=+22.831403096" Sep 10 20:55:03.631907 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.631844 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7fqqt" podStartSLOduration=6.818348357 podStartE2EDuration="21.631827826s" totalImagesPullingTime="14.813479469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:03.630589344 +0000 UTC m=+22.845144633" watchObservedRunningTime="2026-09-10 20:55:03.631827826 +0000 UTC m=+22.846383113" Sep 10 20:55:03.646359 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.646311 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4w2g6" podStartSLOduration=4.476152753 podStartE2EDuration="22.646297236s" totalImagesPullingTime="18.170144483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:03.646207443 +0000 UTC m=+22.860762825" watchObservedRunningTime="2026-09-10 20:55:03.646297236 +0000 UTC m=+22.860852524" Sep 10 20:55:03.685482 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.685437 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ft759" podStartSLOduration=3.511523979 podStartE2EDuration="21.685422316s" totalImagesPullingTime="18.173898337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:03.68517389 +0000 UTC m=+22.899729189" watchObservedRunningTime="2026-09-10 20:55:03.685422316 +0000 UTC m=+22.899977603" Sep 10 20:55:03.911207 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.911024 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:55:03.911751 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.911735 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:55:03.947768 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:03.947639 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 20:55:04.265311 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.265120 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T20:55:03.947657886Z","UUID":"a191d7e8-3ee3-4403-afcc-856ce6881aa8","Handler":null,"Name":"","Endpoint":""} Sep 10 20:55:04.266800 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.266776 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 20:55:04.266942 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.266814 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 20:55:04.320510 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.320479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:04.320707 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.320479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:04.320707 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:04.320656 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:04.320830 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:04.320716 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:04.597807 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.597687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" event={"ID":"66457e77-df34-409b-bc16-ee9319a2de38","Type":"ContainerStarted","Data":"2914051df69c4f6bb43623b1fd640877e941ae00ac591feb9259b7db80b39123"} Sep 10 20:55:04.599463 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.599421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m48xg" event={"ID":"9fb7f6da-af74-4a3b-ac7c-50efa8f85665","Type":"ContainerStarted","Data":"09471bcdbda987c5ad6bf20920cef7b9ec491b21af312fdbe36e472ad6f57907"} Sep 10 20:55:04.600398 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.600367 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:55:04.600944 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.600923 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7fqqt" Sep 10 20:55:04.616706 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:04.616652 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m48xg" podStartSLOduration=5.44717169 podStartE2EDuration="23.616630208s" totalImagesPullingTime="18.169458518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:04.6160946 +0000 UTC m=+23.830649888" watchObservedRunningTime="2026-09-10 20:55:04.616630208 +0000 UTC m=+23.831185499" Sep 10 20:55:05.320819 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:05.320743 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:05.320968 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:05.320874 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:05.604829 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:05.604752 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"f298a5dc6d5566b9362051ff3ad24b2bd3bdd9a3043a82b792aa3137f48fbaef"} Sep 10 20:55:05.607010 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:05.606962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" event={"ID":"66457e77-df34-409b-bc16-ee9319a2de38","Type":"ContainerStarted","Data":"e6852e63e1578675b5fb549b8afd1781527f4e9f577a3c055f854ec835bb0c69"} Sep 10 20:55:05.623545 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:05.623498 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6xjz" podStartSLOduration=4.326490332 podStartE2EDuration="24.623479886s" totalImagesPullingTime="20.296989554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:05.622607501 +0000 UTC m=+24.837162790" watchObservedRunningTime="2026-09-10 20:55:05.623479886 +0000 UTC m=+24.838035174" Sep 10 20:55:06.320082 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:06.320045 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:06.320082 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:06.320069 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:06.320320 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:06.320168 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:06.320320 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:06.320287 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:07.320374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:07.320335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:07.320918 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:07.320510 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:08.253394 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:08.253362 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4w2g6_7a261123-3ff1-4cd9-b17e-073352b72a75/dns-node-resolver/0.log" Sep 10 20:55:08.320319 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:08.320283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:08.320319 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:08.320315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:08.320833 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:08.320407 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:08.320833 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:08.320606 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:09.320508 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.320475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:09.321126 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:09.320617 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:09.428275 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.428249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ft759_cea5094b-f793-41e4-9177-f3daba3c0e1b/node-ca/0.log" Sep 10 20:55:09.617854 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.617819 2563 generic.go:356] "Generic (PLEG): container finished" podID="026cbc27-4f88-49b1-855a-7fed14f763ca" containerID="aaa5381fa026f4addffaee77fa97048d884c9090e03f730aef7eed40067bedc4" exitCode=0 Sep 10 20:55:09.618032 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.617909 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerDied","Data":"aaa5381fa026f4addffaee77fa97048d884c9090e03f730aef7eed40067bedc4"} Sep 10 20:55:09.621832 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.621756 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" event={"ID":"07e3e1cd-c9a0-486e-a643-107f091b81ed","Type":"ContainerStarted","Data":"b8d1d9b71044172318b0ea92a306e81274b9127380e7697c5221ce025b11ff83"} Sep 10 20:55:09.622051 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.622026 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:55:09.622139 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.622108 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:55:09.622203 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.622156 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:55:09.637541 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.637516 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:55:09.642073 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.642052 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:55:09.658441 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:09.658401 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" podStartSLOduration=10.42426959 podStartE2EDuration="28.658387051s" totalImagesPullingTime="18.234117461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:09.657869123 +0000 UTC m=+28.872424410" watchObservedRunningTime="2026-09-10 20:55:09.658387051 +0000 UTC m=+28.872942339" Sep 10 20:55:10.320759 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.320731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:10.321341 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.320731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:10.321341 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:10.320862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:10.321341 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:10.320912 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:10.753362 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.753001 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-86jxv"] Sep 10 20:55:10.753475 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.753374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:10.753475 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:10.753466 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:10.757043 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.756801 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s5kwb"] Sep 10 20:55:10.757043 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.756910 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:10.757043 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:10.757008 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:10.757439 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.757400 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w6zkl"] Sep 10 20:55:10.757575 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:10.757510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:10.757651 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:10.757629 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:11.628765 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:11.628729 2563 generic.go:356] "Generic (PLEG): container finished" podID="026cbc27-4f88-49b1-855a-7fed14f763ca" containerID="1f2ef749d7030e73ca7389d77954c820ed8fbe4a879e90f36fdb7c759458640b" exitCode=0 Sep 10 20:55:11.629142 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:11.628809 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerDied","Data":"1f2ef749d7030e73ca7389d77954c820ed8fbe4a879e90f36fdb7c759458640b"} Sep 10 20:55:12.320293 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:12.320262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:12.320481 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:12.320262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:12.320481 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:12.320392 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:12.320481 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:12.320262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:12.320663 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:12.320482 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:12.320663 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:12.320551 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:13.634858 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:13.634817 2563 generic.go:356] "Generic (PLEG): container finished" podID="026cbc27-4f88-49b1-855a-7fed14f763ca" containerID="e0e6b9434e6be6c3b5c0bc28ab5bb00b399f3365328ed4815630d95dac698b24" exitCode=0 Sep 10 20:55:13.635339 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:13.634898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerDied","Data":"e0e6b9434e6be6c3b5c0bc28ab5bb00b399f3365328ed4815630d95dac698b24"} Sep 10 20:55:14.320257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:14.320217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:14.320257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:14.320252 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:14.320509 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:14.320252 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:14.320509 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.320333 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:14.320509 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.320458 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:14.320713 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.320548 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:14.928374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:14.928340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:14.928840 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:14.928400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:14.928840 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.928498 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:55:14.928840 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.928528 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 20:55:14.928840 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.928556 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs podName:933b4eae-c038-460e-8ea7-bddfcdd99f60 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:46.928540431 +0000 UTC m=+66.143095698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs") pod "network-metrics-daemon-w6zkl" (UID: "933b4eae-c038-460e-8ea7-bddfcdd99f60") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 20:55:14.928840 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.928558 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 20:55:14.928840 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.928591 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lbnbh for pod openshift-network-diagnostics/network-check-target-s5kwb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:55:14.928840 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:14.928625 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh podName:06855ecc-d7cb-4421-acf4-ffb6543dbc6e nodeName:}" failed. No retries permitted until 2026-09-10 20:55:46.9286147 +0000 UTC m=+66.143169966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbnbh" (UniqueName: "kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh") pod "network-check-target-s5kwb" (UID: "06855ecc-d7cb-4421-acf4-ffb6543dbc6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 20:55:15.029630 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:15.029414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:15.029806 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:15.029601 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 20:55:15.029806 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:15.029723 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret podName:3380d104-eb93-44ee-be7d-9ef83e8737c1 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:47.029706898 +0000 UTC m=+66.244262164 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret") pod "global-pull-secret-syncer-86jxv" (UID: "3380d104-eb93-44ee-be7d-9ef83e8737c1") : object "kube-system"/"original-pull-secret" not registered Sep 10 20:55:16.320840 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:16.320805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:16.320840 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:16.320829 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:16.320840 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:16.320850 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:16.321379 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:16.320947 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:16.321379 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:16.321037 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:16.321379 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:16.321112 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:18.320643 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:18.320604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:18.320643 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:18.320629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:18.321124 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:18.320613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:18.321124 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:18.320732 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:18.321124 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:18.320845 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:18.321124 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:18.320921 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:18.649799 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:18.649774 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerStarted","Data":"f02cb140466915e4c1f72d206ccce7b20f3ea24fa6fe50274883ce7b7606a399"} Sep 10 20:55:19.654593 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:19.654547 2563 generic.go:356] "Generic (PLEG): container finished" podID="026cbc27-4f88-49b1-855a-7fed14f763ca" containerID="f02cb140466915e4c1f72d206ccce7b20f3ea24fa6fe50274883ce7b7606a399" exitCode=0 Sep 10 20:55:19.654971 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:19.654597 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerDied","Data":"f02cb140466915e4c1f72d206ccce7b20f3ea24fa6fe50274883ce7b7606a399"} Sep 10 20:55:20.320293 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:20.320268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:20.320405 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:20.320268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:20.320405 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:20.320390 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:20.320534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:20.320268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:20.320534 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:20.320452 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:20.320534 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:20.320522 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:20.660502 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:20.660411 2563 generic.go:356] "Generic (PLEG): container finished" podID="026cbc27-4f88-49b1-855a-7fed14f763ca" containerID="7a8a0d468dce32e94fc4da36ef22ac39b3b9afa8c95c27d0ce9ef0e3511bfc9c" exitCode=0 Sep 10 20:55:20.660502 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:20.660460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerDied","Data":"7a8a0d468dce32e94fc4da36ef22ac39b3b9afa8c95c27d0ce9ef0e3511bfc9c"} Sep 10 20:55:21.666521 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:21.666489 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" event={"ID":"026cbc27-4f88-49b1-855a-7fed14f763ca","Type":"ContainerStarted","Data":"7f9511732b1784a0a1fa7784538cab90ce038ecc0be83d3f0f190affb8e3211d"} Sep 10 20:55:21.687707 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:21.687658 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kl5dl" podStartSLOduration=9.995317756 podStartE2EDuration="40.687642476s" totalImagesPullingTime="30.69232472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:21.686783679 +0000 UTC m=+40.901338967" watchObservedRunningTime="2026-09-10 20:55:21.687642476 +0000 UTC m=+40.902197763" Sep 10 20:55:22.319998 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:22.319961 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:22.320177 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:22.319970 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:22.320177 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:22.319982 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:22.320177 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:22.320165 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:22.320336 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:22.320213 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:22.320336 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:22.320068 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:24.319951 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:24.319919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:24.320310 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:24.320017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:24.320310 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:24.320024 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:24.320310 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:24.320046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:24.320310 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:24.320119 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:24.320310 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:24.320188 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:26.320306 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:26.320271 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:26.320306 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:26.320296 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:26.320744 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:26.320271 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:26.320744 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:26.320382 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:26.320744 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:26.320435 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:26.320744 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:26.320519 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:28.320160 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:28.320124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:28.320616 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:28.320142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:28.320616 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:28.320248 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:28.320616 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:28.320255 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:28.320616 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:28.320311 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:28.320616 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:28.320383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:30.320829 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:30.320793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:30.320829 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:30.320825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:30.321298 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:30.320913 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s5kwb" podUID="06855ecc-d7cb-4421-acf4-ffb6543dbc6e" Sep 10 20:55:30.321298 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:30.320941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:30.321298 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:30.321003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86jxv" podUID="3380d104-eb93-44ee-be7d-9ef83e8737c1" Sep 10 20:55:30.321298 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:30.321056 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6zkl" podUID="933b4eae-c038-460e-8ea7-bddfcdd99f60" Sep 10 20:55:31.523042 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.523012 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-97.ec2.internal" event="NodeReady" Sep 10 20:55:31.523408 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.523138 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 20:55:31.567987 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.567953 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g64kw"] Sep 10 20:55:31.569776 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.569760 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.571509 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.571483 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h5nm8"] Sep 10 20:55:31.572474 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.572451 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 20:55:31.572586 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.572480 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2szv\"" Sep 10 20:55:31.572655 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.572603 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 20:55:31.573185 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.573171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.575111 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.575095 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 20:55:31.575250 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.575234 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 20:55:31.575642 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.575601 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 20:55:31.575733 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.575603 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k7sz9\"" Sep 10 20:55:31.581853 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.581833 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g64kw"] Sep 10 20:55:31.590793 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.590774 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h5nm8"] Sep 10 20:55:31.670954 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.670918 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-54nlv"] Sep 10 20:55:31.672815 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.672798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.674907 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.674883 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 20:55:31.675029 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.674929 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 20:55:31.675029 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.674994 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 20:55:31.675029 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.675006 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 20:55:31.675203 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.675173 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w469x\"" Sep 10 20:55:31.683521 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.683500 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-54nlv"] Sep 10 20:55:31.739848 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.739812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d29f066-7f03-4068-99b0-351aac3953d9-metrics-tls\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.739848 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.739852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c7daa87-6d73-41dd-a752-3a3bb06c8635-cert\") pod \"ingress-canary-h5nm8\" (UID: \"6c7daa87-6d73-41dd-a752-3a3bb06c8635\") " pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.740129 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.739875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d29f066-7f03-4068-99b0-351aac3953d9-tmp-dir\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.740129 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.739893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7dth\" (UniqueName: \"kubernetes.io/projected/1d29f066-7f03-4068-99b0-351aac3953d9-kube-api-access-p7dth\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.740129 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.739948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d29f066-7f03-4068-99b0-351aac3953d9-config-volume\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.740129 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.739977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kh6c\" (UniqueName: \"kubernetes.io/projected/6c7daa87-6d73-41dd-a752-3a3bb06c8635-kube-api-access-5kh6c\") pod \"ingress-canary-h5nm8\" (UID: \"6c7daa87-6d73-41dd-a752-3a3bb06c8635\") " pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.841256 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d29f066-7f03-4068-99b0-351aac3953d9-metrics-tls\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.841256 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89c2b812-b7d1-4957-9628-1146fb651e9a-crio-socket\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.841445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c7daa87-6d73-41dd-a752-3a3bb06c8635-cert\") pod \"ingress-canary-h5nm8\" (UID: \"6c7daa87-6d73-41dd-a752-3a3bb06c8635\") " pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.841445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d29f066-7f03-4068-99b0-351aac3953d9-tmp-dir\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.841445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7dth\" (UniqueName: \"kubernetes.io/projected/1d29f066-7f03-4068-99b0-351aac3953d9-kube-api-access-p7dth\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.841445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c2b812-b7d1-4957-9628-1146fb651e9a-data-volume\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.841445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89c2b812-b7d1-4957-9628-1146fb651e9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.841445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d29f066-7f03-4068-99b0-351aac3953d9-config-volume\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.841770 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmkxq\" (UniqueName: \"kubernetes.io/projected/89c2b812-b7d1-4957-9628-1146fb651e9a-kube-api-access-kmkxq\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.841770 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kh6c\" (UniqueName: \"kubernetes.io/projected/6c7daa87-6d73-41dd-a752-3a3bb06c8635-kube-api-access-5kh6c\") pod \"ingress-canary-h5nm8\" (UID: \"6c7daa87-6d73-41dd-a752-3a3bb06c8635\") " pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.841770 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841716 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89c2b812-b7d1-4957-9628-1146fb651e9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.841770 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.841739 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d29f066-7f03-4068-99b0-351aac3953d9-tmp-dir\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.842530 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.842510 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d29f066-7f03-4068-99b0-351aac3953d9-config-volume\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.845232 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.845209 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d29f066-7f03-4068-99b0-351aac3953d9-metrics-tls\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.845334 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.845313 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c7daa87-6d73-41dd-a752-3a3bb06c8635-cert\") pod \"ingress-canary-h5nm8\" (UID: \"6c7daa87-6d73-41dd-a752-3a3bb06c8635\") " pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.848814 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.848783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7dth\" (UniqueName: \"kubernetes.io/projected/1d29f066-7f03-4068-99b0-351aac3953d9-kube-api-access-p7dth\") pod \"dns-default-g64kw\" (UID: \"1d29f066-7f03-4068-99b0-351aac3953d9\") " pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.848931 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.848813 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kh6c\" (UniqueName: \"kubernetes.io/projected/6c7daa87-6d73-41dd-a752-3a3bb06c8635-kube-api-access-5kh6c\") pod \"ingress-canary-h5nm8\" (UID: \"6c7daa87-6d73-41dd-a752-3a3bb06c8635\") " pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.880835 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.880793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:31.884896 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.884877 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h5nm8" Sep 10 20:55:31.942497 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.942342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkxq\" (UniqueName: \"kubernetes.io/projected/89c2b812-b7d1-4957-9628-1146fb651e9a-kube-api-access-kmkxq\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.942497 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.942438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89c2b812-b7d1-4957-9628-1146fb651e9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.942497 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.942494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89c2b812-b7d1-4957-9628-1146fb651e9a-crio-socket\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.942752 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.942517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c2b812-b7d1-4957-9628-1146fb651e9a-data-volume\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.942752 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.942535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89c2b812-b7d1-4957-9628-1146fb651e9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.942860 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.942758 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89c2b812-b7d1-4957-9628-1146fb651e9a-crio-socket\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.943262 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.943001 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c2b812-b7d1-4957-9628-1146fb651e9a-data-volume\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.943262 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.943165 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89c2b812-b7d1-4957-9628-1146fb651e9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.945780 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.945743 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89c2b812-b7d1-4957-9628-1146fb651e9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.951199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.951150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmkxq\" (UniqueName: \"kubernetes.io/projected/89c2b812-b7d1-4957-9628-1146fb651e9a-kube-api-access-kmkxq\") pod \"insights-runtime-extractor-54nlv\" (UID: \"89c2b812-b7d1-4957-9628-1146fb651e9a\") " pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:31.981043 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:31.981012 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-54nlv" Sep 10 20:55:32.159619 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.159515 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h5nm8"] Sep 10 20:55:32.162938 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.162915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g64kw"] Sep 10 20:55:32.163786 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:32.163764 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7daa87_6d73_41dd_a752_3a3bb06c8635.slice/crio-c0adf3645c0f2f6473f1a3b8225076026a32d08abffe10dd29bcc8b02d60ad99 WatchSource:0}: Error finding container c0adf3645c0f2f6473f1a3b8225076026a32d08abffe10dd29bcc8b02d60ad99: Status 404 returned error can't find the container with id c0adf3645c0f2f6473f1a3b8225076026a32d08abffe10dd29bcc8b02d60ad99 Sep 10 20:55:32.166212 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:32.166155 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d29f066_7f03_4068_99b0_351aac3953d9.slice/crio-533823dcd7e31c4f3e3eb9c91ea3160f896bc8ad4c0f24100593c7b9b1fd2ebb WatchSource:0}: Error finding container 533823dcd7e31c4f3e3eb9c91ea3160f896bc8ad4c0f24100593c7b9b1fd2ebb: Status 404 returned error can't find the container with id 533823dcd7e31c4f3e3eb9c91ea3160f896bc8ad4c0f24100593c7b9b1fd2ebb Sep 10 20:55:32.250142 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.250110 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-54nlv"] Sep 10 20:55:32.253376 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:32.253354 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c2b812_b7d1_4957_9628_1146fb651e9a.slice/crio-da05e96dab3c9a4de2fd193e09c78492d9df1fe1acb49617baa37b32ae8840ba WatchSource:0}: Error finding container da05e96dab3c9a4de2fd193e09c78492d9df1fe1acb49617baa37b32ae8840ba: Status 404 returned error can't find the container with id da05e96dab3c9a4de2fd193e09c78492d9df1fe1acb49617baa37b32ae8840ba Sep 10 20:55:32.320982 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.320954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:32.321089 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.320987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:32.321089 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.320992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:32.323477 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.323455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 20:55:32.323594 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.323460 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 20:55:32.323594 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.323585 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-597hv\"" Sep 10 20:55:32.323783 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.323753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 20:55:32.323897 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.323880 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w8kfv\"" Sep 10 20:55:32.327427 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.324315 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 20:55:32.693076 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.693040 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g64kw" event={"ID":"1d29f066-7f03-4068-99b0-351aac3953d9","Type":"ContainerStarted","Data":"533823dcd7e31c4f3e3eb9c91ea3160f896bc8ad4c0f24100593c7b9b1fd2ebb"} Sep 10 20:55:32.696021 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.695988 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54nlv" event={"ID":"89c2b812-b7d1-4957-9628-1146fb651e9a","Type":"ContainerStarted","Data":"c9819a57192e777ce70143fb7319e6f7a8f401d797932b7c3e3efae701c029b3"} Sep 10 20:55:32.696226 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.696052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54nlv" event={"ID":"89c2b812-b7d1-4957-9628-1146fb651e9a","Type":"ContainerStarted","Data":"da05e96dab3c9a4de2fd193e09c78492d9df1fe1acb49617baa37b32ae8840ba"} Sep 10 20:55:32.699417 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:32.699389 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h5nm8" event={"ID":"6c7daa87-6d73-41dd-a752-3a3bb06c8635","Type":"ContainerStarted","Data":"c0adf3645c0f2f6473f1a3b8225076026a32d08abffe10dd29bcc8b02d60ad99"} Sep 10 20:55:33.704753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:33.704712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54nlv" event={"ID":"89c2b812-b7d1-4957-9628-1146fb651e9a","Type":"ContainerStarted","Data":"3f98700b11a6100dd1f363e23ca70ef0d5f35515b169ee75e60a7535aa47592e"} Sep 10 20:55:35.100976 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.100938 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw"] Sep 10 20:55:35.103504 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.103083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:35.106681 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.106552 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 20:55:35.107022 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.106844 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9qsgq\"" Sep 10 20:55:35.113762 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.112892 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw"] Sep 10 20:55:35.268706 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.268674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d41527bf-ee48-4843-916c-bbcc8e1a1c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-xx5lw\" (UID: \"d41527bf-ee48-4843-916c-bbcc8e1a1c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:35.369579 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.369508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d41527bf-ee48-4843-916c-bbcc8e1a1c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-xx5lw\" (UID: \"d41527bf-ee48-4843-916c-bbcc8e1a1c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:35.369772 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:35.369686 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 10 20:55:35.369872 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:35.369773 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d41527bf-ee48-4843-916c-bbcc8e1a1c69-tls-certificates podName:d41527bf-ee48-4843-916c-bbcc8e1a1c69 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:35.869747182 +0000 UTC m=+55.084302447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d41527bf-ee48-4843-916c-bbcc8e1a1c69-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-xx5lw" (UID: "d41527bf-ee48-4843-916c-bbcc8e1a1c69") : secret "prometheus-operator-admission-webhook-tls" not found Sep 10 20:55:35.716588 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.716478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54nlv" event={"ID":"89c2b812-b7d1-4957-9628-1146fb651e9a","Type":"ContainerStarted","Data":"52844a2f0fc68f6eacbdef227068386c512eb543250bb3140b2786a52f1e56e0"} Sep 10 20:55:35.717984 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.717960 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h5nm8" event={"ID":"6c7daa87-6d73-41dd-a752-3a3bb06c8635","Type":"ContainerStarted","Data":"bd382ffdac0f02745598707ce0e92dc39883bfc0d233cebd3acfc38771538812"} Sep 10 20:55:35.719596 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.719555 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g64kw" event={"ID":"1d29f066-7f03-4068-99b0-351aac3953d9","Type":"ContainerStarted","Data":"90030acbc426de9ca22269db2df51bfaed3a0a3862909cf4565c54be8a2a5ae7"} Sep 10 20:55:35.719688 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.719609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g64kw" event={"ID":"1d29f066-7f03-4068-99b0-351aac3953d9","Type":"ContainerStarted","Data":"780ee56948f70969f76348cf2b88e0a99c5ea8f553cd30cb8b6e71789b32b415"} Sep 10 20:55:35.719767 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.719709 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:35.733880 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.733830 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-54nlv" podStartSLOduration=2.146820354 podStartE2EDuration="4.733814624s" totalImagesPullingTime="2.58699427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:55:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:35.732490767 +0000 UTC m=+54.947046055" watchObservedRunningTime="2026-09-10 20:55:35.733814624 +0000 UTC m=+54.948369911" Sep 10 20:55:35.748683 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.748633 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h5nm8" podStartSLOduration=1.923711 podStartE2EDuration="4.74861671s" totalImagesPullingTime="2.82490571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:35.747665988 +0000 UTC m=+54.962221279" watchObservedRunningTime="2026-09-10 20:55:35.74861671 +0000 UTC m=+54.963171998" Sep 10 20:55:35.772024 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.771965 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g64kw" podStartSLOduration=1.9570665809999999 podStartE2EDuration="4.771940451s" totalImagesPullingTime="2.81487387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:35.770957157 +0000 UTC m=+54.985512446" watchObservedRunningTime="2026-09-10 20:55:35.771940451 +0000 UTC m=+54.986495740" Sep 10 20:55:35.873155 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.873108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d41527bf-ee48-4843-916c-bbcc8e1a1c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-xx5lw\" (UID: \"d41527bf-ee48-4843-916c-bbcc8e1a1c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:35.875661 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:35.875634 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d41527bf-ee48-4843-916c-bbcc8e1a1c69-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-xx5lw\" (UID: \"d41527bf-ee48-4843-916c-bbcc8e1a1c69\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:36.017253 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.017217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:36.281454 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.281382 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw"] Sep 10 20:55:36.284881 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:36.284856 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41527bf_ee48_4843_916c_bbcc8e1a1c69.slice/crio-85750f2f6f73c68cdaf959d7c1454eea83c5c484bfbe434bbb478dd592fb961b WatchSource:0}: Error finding container 85750f2f6f73c68cdaf959d7c1454eea83c5c484bfbe434bbb478dd592fb961b: Status 404 returned error can't find the container with id 85750f2f6f73c68cdaf959d7c1454eea83c5c484bfbe434bbb478dd592fb961b Sep 10 20:55:36.427104 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.427069 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-776f6c4b58-4w2rq"] Sep 10 20:55:36.429520 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.429501 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.432436 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 20:55:36.432436 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432429 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 20:55:36.432670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432470 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 20:55:36.432670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432491 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zjj9k\"" Sep 10 20:55:36.432670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432499 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 20:55:36.432670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432414 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 20:55:36.432670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432429 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 20:55:36.432670 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.432557 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 20:55:36.440854 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.440831 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f6c4b58-4w2rq"] Sep 10 20:55:36.578669 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.578555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-oauth-config\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.578669 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.578635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-service-ca\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.578886 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.578675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb9b8\" (UniqueName: \"kubernetes.io/projected/74916aa6-9a3d-4206-9130-f357c754c345-kube-api-access-nb9b8\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.578886 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.578740 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-serving-cert\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.578886 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.578758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-oauth-serving-cert\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.578886 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.578805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-console-config\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.679732 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.679686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9b8\" (UniqueName: \"kubernetes.io/projected/74916aa6-9a3d-4206-9130-f357c754c345-kube-api-access-nb9b8\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.679907 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.679765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-serving-cert\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.679907 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.679791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-oauth-serving-cert\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.679907 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.679826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-console-config\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.680019 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.679955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-oauth-config\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.680066 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.680021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-service-ca\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.680657 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.680631 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-service-ca\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.680760 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.680713 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-console-config\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.680760 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.680747 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-oauth-serving-cert\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.682448 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.682426 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-oauth-config\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.682548 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.682531 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-serving-cert\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.687889 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.687867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb9b8\" (UniqueName: \"kubernetes.io/projected/74916aa6-9a3d-4206-9130-f357c754c345-kube-api-access-nb9b8\") pod \"console-776f6c4b58-4w2rq\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:36.723915 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.723872 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" event={"ID":"d41527bf-ee48-4843-916c-bbcc8e1a1c69","Type":"ContainerStarted","Data":"85750f2f6f73c68cdaf959d7c1454eea83c5c484bfbe434bbb478dd592fb961b"} Sep 10 20:55:36.739527 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:36.739498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:37.009667 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:37.009615 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f6c4b58-4w2rq"] Sep 10 20:55:37.013836 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:37.013805 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74916aa6_9a3d_4206_9130_f357c754c345.slice/crio-c1bed3dbf6a1cd5399c99cf35a4790b07e218ddecc67fb91853ed8e6a17e67bd WatchSource:0}: Error finding container c1bed3dbf6a1cd5399c99cf35a4790b07e218ddecc67fb91853ed8e6a17e67bd: Status 404 returned error can't find the container with id c1bed3dbf6a1cd5399c99cf35a4790b07e218ddecc67fb91853ed8e6a17e67bd Sep 10 20:55:37.728608 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:37.728555 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" event={"ID":"d41527bf-ee48-4843-916c-bbcc8e1a1c69","Type":"ContainerStarted","Data":"ff00ce8a2304f7dfd178da8418f866273acb19fd660432635cba9ba10fffc1c5"} Sep 10 20:55:37.729059 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:37.728742 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:37.730261 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:37.730237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f6c4b58-4w2rq" event={"ID":"74916aa6-9a3d-4206-9130-f357c754c345","Type":"ContainerStarted","Data":"c1bed3dbf6a1cd5399c99cf35a4790b07e218ddecc67fb91853ed8e6a17e67bd"} Sep 10 20:55:37.734372 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:37.734347 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" Sep 10 20:55:37.757717 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:37.757663 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xx5lw" podStartSLOduration=1.737153611 podStartE2EDuration="2.75764104s" totalImagesPullingTime="1.020487429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:37.743266037 +0000 UTC m=+56.957821326" watchObservedRunningTime="2026-09-10 20:55:37.75764104 +0000 UTC m=+56.972196327" Sep 10 20:55:38.180651 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.180549 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj"] Sep 10 20:55:38.182775 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.182753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.184981 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.184952 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 20:55:38.185099 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.185014 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 20:55:38.185852 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.185831 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 20:55:38.185852 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.185848 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 20:55:38.186026 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.185888 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 20:55:38.186026 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.185891 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mndlp\"" Sep 10 20:55:38.191849 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.191826 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj"] Sep 10 20:55:38.293460 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.293420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/301a9750-5ae1-4bb0-83de-046010e55d7a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.293643 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.293474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/301a9750-5ae1-4bb0-83de-046010e55d7a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.293643 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.293591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/301a9750-5ae1-4bb0-83de-046010e55d7a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.293643 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.293619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrq67\" (UniqueName: \"kubernetes.io/projected/301a9750-5ae1-4bb0-83de-046010e55d7a-kube-api-access-wrq67\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.395046 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.395003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/301a9750-5ae1-4bb0-83de-046010e55d7a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.395046 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.395045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/301a9750-5ae1-4bb0-83de-046010e55d7a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.395270 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.395112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/301a9750-5ae1-4bb0-83de-046010e55d7a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.395270 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.395138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrq67\" (UniqueName: \"kubernetes.io/projected/301a9750-5ae1-4bb0-83de-046010e55d7a-kube-api-access-wrq67\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.396173 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.396141 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/301a9750-5ae1-4bb0-83de-046010e55d7a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.397773 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.397718 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/301a9750-5ae1-4bb0-83de-046010e55d7a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.398234 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.398201 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/301a9750-5ae1-4bb0-83de-046010e55d7a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.403994 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.403963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrq67\" (UniqueName: \"kubernetes.io/projected/301a9750-5ae1-4bb0-83de-046010e55d7a-kube-api-access-wrq67\") pod \"prometheus-operator-68bcd7f987-9hjbj\" (UID: \"301a9750-5ae1-4bb0-83de-046010e55d7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.491993 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.491961 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" Sep 10 20:55:38.758628 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:38.758525 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj"] Sep 10 20:55:39.686926 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:39.686891 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301a9750_5ae1_4bb0_83de_046010e55d7a.slice/crio-bfd14582d20485c3a712d1e34e7c61f7e7914192e59fab10dc498318d20ae16a WatchSource:0}: Error finding container bfd14582d20485c3a712d1e34e7c61f7e7914192e59fab10dc498318d20ae16a: Status 404 returned error can't find the container with id bfd14582d20485c3a712d1e34e7c61f7e7914192e59fab10dc498318d20ae16a Sep 10 20:55:39.738397 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:39.738373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" event={"ID":"301a9750-5ae1-4bb0-83de-046010e55d7a","Type":"ContainerStarted","Data":"bfd14582d20485c3a712d1e34e7c61f7e7914192e59fab10dc498318d20ae16a"} Sep 10 20:55:40.607474 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.607432 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c698dbbc-bxt5k"] Sep 10 20:55:40.610851 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.610827 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.617742 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.617713 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 20:55:40.620530 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.620146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c698dbbc-bxt5k"] Sep 10 20:55:40.715089 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.715046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl62r\" (UniqueName: \"kubernetes.io/projected/b5b76eb2-e275-4931-b6e4-903892724d0d-kube-api-access-zl62r\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.715264 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.715214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-oauth-config\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.715264 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.715254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-console-config\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.715373 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.715278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-service-ca\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.715373 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.715330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-trusted-ca-bundle\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.715451 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.715394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-oauth-serving-cert\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.715451 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.715416 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-serving-cert\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.747033 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.747001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f6c4b58-4w2rq" event={"ID":"74916aa6-9a3d-4206-9130-f357c754c345","Type":"ContainerStarted","Data":"83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d"} Sep 10 20:55:40.765829 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.765718 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-776f6c4b58-4w2rq" podStartSLOduration=2.05155707 podStartE2EDuration="4.765696493s" totalImagesPullingTime="2.714139423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:40.764971443 +0000 UTC m=+59.979526732" watchObservedRunningTime="2026-09-10 20:55:40.765696493 +0000 UTC m=+59.980251781" Sep 10 20:55:40.816256 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.816220 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-oauth-config\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.816256 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.816261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-console-config\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.816465 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.816288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-service-ca\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.816465 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.816318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-trusted-ca-bundle\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.816465 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.816368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-oauth-serving-cert\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.816465 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.816392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-serving-cert\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.816676 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.816526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl62r\" (UniqueName: \"kubernetes.io/projected/b5b76eb2-e275-4931-b6e4-903892724d0d-kube-api-access-zl62r\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.817117 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.817090 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-console-config\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.817221 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.817135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-oauth-serving-cert\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.817294 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.817277 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-service-ca\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.817334 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.817288 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-trusted-ca-bundle\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.819271 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.819243 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-serving-cert\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.819349 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.819330 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-oauth-config\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.825384 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.825355 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl62r\" (UniqueName: \"kubernetes.io/projected/b5b76eb2-e275-4931-b6e4-903892724d0d-kube-api-access-zl62r\") pod \"console-59c698dbbc-bxt5k\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:40.922310 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:40.922284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:41.199499 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.199395 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c698dbbc-bxt5k"] Sep 10 20:55:41.204624 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:41.204596 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b76eb2_e275_4931_b6e4_903892724d0d.slice/crio-82457431875fb2776f73898426fa973a78e10ffca1debe3693872d678d072f0e WatchSource:0}: Error finding container 82457431875fb2776f73898426fa973a78e10ffca1debe3693872d678d072f0e: Status 404 returned error can't find the container with id 82457431875fb2776f73898426fa973a78e10ffca1debe3693872d678d072f0e Sep 10 20:55:41.648294 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.648265 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdq" Sep 10 20:55:41.752000 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.751962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c698dbbc-bxt5k" event={"ID":"b5b76eb2-e275-4931-b6e4-903892724d0d","Type":"ContainerStarted","Data":"4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c"} Sep 10 20:55:41.752163 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.752030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c698dbbc-bxt5k" event={"ID":"b5b76eb2-e275-4931-b6e4-903892724d0d","Type":"ContainerStarted","Data":"82457431875fb2776f73898426fa973a78e10ffca1debe3693872d678d072f0e"} Sep 10 20:55:41.753704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.753669 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" event={"ID":"301a9750-5ae1-4bb0-83de-046010e55d7a","Type":"ContainerStarted","Data":"1b785ef104d0e4d5c712e5a21f5fc7e31aaea63f907e93c000fe8db20a0eab48"} Sep 10 20:55:41.753852 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.753739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" event={"ID":"301a9750-5ae1-4bb0-83de-046010e55d7a","Type":"ContainerStarted","Data":"cd6f7ede5a298eedcae0167094e47c2841bbb2f51e770099b3fcf8a6559c725f"} Sep 10 20:55:41.768106 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.767936 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c698dbbc-bxt5k" podStartSLOduration=1.7679232059999999 podStartE2EDuration="1.767923206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:41.767865944 +0000 UTC m=+60.982421244" watchObservedRunningTime="2026-09-10 20:55:41.767923206 +0000 UTC m=+60.982478494" Sep 10 20:55:41.789326 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:41.789250 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-9hjbj" podStartSLOduration=2.6240205850000002 podStartE2EDuration="3.789228941s" totalImagesPullingTime="1.165208356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:41.788765406 +0000 UTC m=+61.003320693" watchObservedRunningTime="2026-09-10 20:55:41.789228941 +0000 UTC m=+61.003784229" Sep 10 20:55:43.540984 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.540952 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf"] Sep 10 20:55:43.543511 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.543494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.545618 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.545591 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 20:55:43.545803 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.545784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 20:55:43.545862 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.545818 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4pgdf\"" Sep 10 20:55:43.560817 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.560781 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf"] Sep 10 20:55:43.567160 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.567132 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx"] Sep 10 20:55:43.569317 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.569302 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.571390 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.571371 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 20:55:43.571631 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.571616 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 20:55:43.571631 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.571624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p4jmx\"" Sep 10 20:55:43.571743 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.571704 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 20:55:43.577206 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.577176 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wtbhl"] Sep 10 20:55:43.579156 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.579137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.581407 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.581386 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pczld\"" Sep 10 20:55:43.581643 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.581622 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 20:55:43.581799 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.581781 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 20:55:43.581884 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.581871 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 20:55:43.583236 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.583213 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx"] Sep 10 20:55:43.642540 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.642498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5733f1b8-d99d-4b42-94e4-250b23352806-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.642761 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.642633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.642761 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.642677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ml5\" (UniqueName: \"kubernetes.io/projected/5733f1b8-d99d-4b42-94e4-250b23352806-kube-api-access-54ml5\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.642761 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.642747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.743179 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-tls\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5733f1b8-d99d-4b42-94e4-250b23352806-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.743324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/742200fb-0b2b-4caa-96a3-3055f0a93f0c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.743324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743270 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njc6q\" (UniqueName: \"kubernetes.io/projected/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-kube-api-access-njc6q\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.743534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-textfile\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ml5\" (UniqueName: \"kubernetes.io/projected/5733f1b8-d99d-4b42-94e4-250b23352806-kube-api-access-54ml5\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.743534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-root\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743462 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-wtmp\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743534 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:43.743473 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 20:55:43.743534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-metrics-client-ca\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:43.743552 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-tls podName:5733f1b8-d99d-4b42-94e4-250b23352806 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:44.243528842 +0000 UTC m=+63.458084112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-5cnzf" (UID: "5733f1b8-d99d-4b42-94e4-250b23352806") : secret "openshift-state-metrics-tls" not found Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-sys\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/742200fb-0b2b-4caa-96a3-3055f0a93f0c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-572rd\" (UniqueName: \"kubernetes.io/projected/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-api-access-572rd\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.743924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.744282 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.743956 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5733f1b8-d99d-4b42-94e4-250b23352806-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.746087 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.746065 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.754506 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.754482 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ml5\" (UniqueName: \"kubernetes.io/projected/5733f1b8-d99d-4b42-94e4-250b23352806-kube-api-access-54ml5\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:43.844508 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-572rd\" (UniqueName: \"kubernetes.io/projected/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-api-access-572rd\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.844508 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.844508 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.844508 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-tls\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.844822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/742200fb-0b2b-4caa-96a3-3055f0a93f0c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.844822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844552 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.844822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njc6q\" (UniqueName: \"kubernetes.io/projected/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-kube-api-access-njc6q\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.844822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-textfile\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.844822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-root\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.844822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.844735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-root\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845252 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-wtmp\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845252 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-metrics-client-ca\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845252 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845173 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/742200fb-0b2b-4caa-96a3-3055f0a93f0c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.845252 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845252 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.845252 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-sys\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845660 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845275 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-wtmp\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845660 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/742200fb-0b2b-4caa-96a3-3055f0a93f0c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.845660 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845329 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.845660 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:43.845444 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 10 20:55:43.845660 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:43.845514 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-tls podName:742200fb-0b2b-4caa-96a3-3055f0a93f0c nodeName:}" failed. No retries permitted until 2026-09-10 20:55:44.345495229 +0000 UTC m=+63.560050502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-jdhxx" (UID: "742200fb-0b2b-4caa-96a3-3055f0a93f0c") : secret "kube-state-metrics-tls" not found Sep 10 20:55:43.845935 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-metrics-client-ca\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845935 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845764 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-sys\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845935 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-textfile\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.845935 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845861 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.846134 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.845990 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/742200fb-0b2b-4caa-96a3-3055f0a93f0c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.847058 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.847025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-tls\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.847175 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.847119 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.847175 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.847125 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.856704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.856683 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-572rd\" (UniqueName: \"kubernetes.io/projected/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-api-access-572rd\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:43.856988 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.856969 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njc6q\" (UniqueName: \"kubernetes.io/projected/d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0-kube-api-access-njc6q\") pod \"node-exporter-wtbhl\" (UID: \"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0\") " pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.890076 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:43.890028 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtbhl" Sep 10 20:55:43.899547 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:43.899523 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd613cb67_36e2_41a8_b1bc_bf9cc9f38fe0.slice/crio-0e2b5aca22b57e4d5d2876704054f14fbd69f3ab2ee41dce10bb5402ada8439e WatchSource:0}: Error finding container 0e2b5aca22b57e4d5d2876704054f14fbd69f3ab2ee41dce10bb5402ada8439e: Status 404 returned error can't find the container with id 0e2b5aca22b57e4d5d2876704054f14fbd69f3ab2ee41dce10bb5402ada8439e Sep 10 20:55:44.249898 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.249865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:44.252229 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.252203 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5733f1b8-d99d-4b42-94e4-250b23352806-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-5cnzf\" (UID: \"5733f1b8-d99d-4b42-94e4-250b23352806\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:44.350374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.350332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:44.352664 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.352645 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/742200fb-0b2b-4caa-96a3-3055f0a93f0c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jdhxx\" (UID: \"742200fb-0b2b-4caa-96a3-3055f0a93f0c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:44.452754 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.452720 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" Sep 10 20:55:44.478307 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.478274 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" Sep 10 20:55:44.623231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.623190 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:55:44.626088 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.626066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628409 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628447 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628511 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628541 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628544 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628644 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628789 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-95wsr\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628860 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 20:55:44.629048 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.628889 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 20:55:44.640319 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.640228 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:55:44.651748 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.651708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.651748 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.651746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-out\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.651975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.651823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.651975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.651878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.651975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.651907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652087 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.651983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652087 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.652013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652087 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.652039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdmht\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-kube-api-access-vdmht\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652176 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.652099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652176 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.652156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652258 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.652191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652258 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.652236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.652329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.652277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-web-config\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.733386 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.733294 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf"] Sep 10 20:55:44.736184 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:44.736155 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5733f1b8_d99d_4b42_94e4_250b23352806.slice/crio-246c7133554d7867530cf4907cabd38749956c33f1ab8e5913870f23bb0164f9 WatchSource:0}: Error finding container 246c7133554d7867530cf4907cabd38749956c33f1ab8e5913870f23bb0164f9: Status 404 returned error can't find the container with id 246c7133554d7867530cf4907cabd38749956c33f1ab8e5913870f23bb0164f9 Sep 10 20:55:44.753127 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753274 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753274 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753274 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-web-config\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753274 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-out\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdmht\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-kube-api-access-vdmht\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.753553 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.753540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.754602 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.754559 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.755128 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:44.755109 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle podName:f5d440ea-13b5-46f8-88bd-c09d5c98e106 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:45.255085017 +0000 UTC m=+64.469640286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106") : configmap references non-existent config key: ca-bundle.crt Sep 10 20:55:44.756109 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:44.756079 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 10 20:55:44.756224 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:44.756139 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls podName:f5d440ea-13b5-46f8-88bd-c09d5c98e106 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:45.256122064 +0000 UTC m=+64.470677332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106") : secret "alertmanager-main-tls" not found Sep 10 20:55:44.757585 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.757529 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-out\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.758004 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.757986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.761498 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.761151 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.761498 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.761218 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.761498 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.761336 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.761692 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.761507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.761692 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.761541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx"] Sep 10 20:55:44.763315 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.763268 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.764058 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.764033 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.764710 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.764669 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-web-config\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.766830 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:44.766808 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742200fb_0b2b_4caa_96a3_3055f0a93f0c.slice/crio-c8475bdde7aa534cab06219ddc3e46f24966adcf7ba18d27ad5e63e5e7b6faac WatchSource:0}: Error finding container c8475bdde7aa534cab06219ddc3e46f24966adcf7ba18d27ad5e63e5e7b6faac: Status 404 returned error can't find the container with id c8475bdde7aa534cab06219ddc3e46f24966adcf7ba18d27ad5e63e5e7b6faac Sep 10 20:55:44.766936 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.766913 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdmht\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-kube-api-access-vdmht\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:44.768964 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.768838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" event={"ID":"5733f1b8-d99d-4b42-94e4-250b23352806","Type":"ContainerStarted","Data":"246c7133554d7867530cf4907cabd38749956c33f1ab8e5913870f23bb0164f9"} Sep 10 20:55:44.770696 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:44.770677 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbhl" event={"ID":"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0","Type":"ContainerStarted","Data":"0e2b5aca22b57e4d5d2876704054f14fbd69f3ab2ee41dce10bb5402ada8439e"} Sep 10 20:55:45.258769 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.258734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:45.258960 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.258841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:45.259743 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.259699 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:45.261686 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.261661 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:45.519778 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.519742 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c6746d97d-h9dnh"] Sep 10 20:55:45.523181 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.523157 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.525667 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.525489 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 20:55:45.525667 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.525614 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 20:55:45.525854 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.525757 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 20:55:45.526296 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.525857 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 20:55:45.526296 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.525865 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6equcafu4aah9\"" Sep 10 20:55:45.526694 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.526673 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6r68q\"" Sep 10 20:55:45.526913 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.526894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 20:55:45.535918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.535896 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c6746d97d-h9dnh"] Sep 10 20:55:45.538531 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.538311 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:55:45.561448 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.561631 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-tls\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.561631 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.561631 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.561779 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.561779 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-grpc-tls\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.561779 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvblt\" (UniqueName: \"kubernetes.io/projected/8accc516-6533-4005-9ad2-5775751aecd8-kube-api-access-qvblt\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.561779 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.561752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8accc516-6533-4005-9ad2-5775751aecd8-metrics-client-ca\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663277 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663745 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-grpc-tls\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663745 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvblt\" (UniqueName: \"kubernetes.io/projected/8accc516-6533-4005-9ad2-5775751aecd8-kube-api-access-qvblt\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663745 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8accc516-6533-4005-9ad2-5775751aecd8-metrics-client-ca\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663745 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663745 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-tls\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663745 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.663745 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.663587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.664845 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.664783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8accc516-6533-4005-9ad2-5775751aecd8-metrics-client-ca\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.667965 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.667380 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-grpc-tls\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.667965 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.667848 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.668615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.668552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.668726 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.668679 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-tls\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.668782 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.668733 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.669249 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.669227 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8accc516-6533-4005-9ad2-5775751aecd8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.675343 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.675307 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvblt\" (UniqueName: \"kubernetes.io/projected/8accc516-6533-4005-9ad2-5775751aecd8-kube-api-access-qvblt\") pod \"thanos-querier-5c6746d97d-h9dnh\" (UID: \"8accc516-6533-4005-9ad2-5775751aecd8\") " pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:45.726987 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.726950 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g64kw" Sep 10 20:55:45.775914 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.775815 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" event={"ID":"742200fb-0b2b-4caa-96a3-3055f0a93f0c","Type":"ContainerStarted","Data":"c8475bdde7aa534cab06219ddc3e46f24966adcf7ba18d27ad5e63e5e7b6faac"} Sep 10 20:55:45.777951 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.777911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" event={"ID":"5733f1b8-d99d-4b42-94e4-250b23352806","Type":"ContainerStarted","Data":"ab58b35e328abd67ef8117616227eca8817c092298f473cb791203bc56268a99"} Sep 10 20:55:45.778090 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.777969 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" event={"ID":"5733f1b8-d99d-4b42-94e4-250b23352806","Type":"ContainerStarted","Data":"1f3710536a1a4eb7aa80d28d3ab962d522fdb0dbcb7f2ed4d163ffa47bec854c"} Sep 10 20:55:45.779775 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.779745 2563 generic.go:356] "Generic (PLEG): container finished" podID="d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0" containerID="587eb73fdce0c4d7774a300bc9b8b1588f5ad9d3b22e18f8e906663165dbf55b" exitCode=0 Sep 10 20:55:45.779870 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.779784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbhl" event={"ID":"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0","Type":"ContainerDied","Data":"587eb73fdce0c4d7774a300bc9b8b1588f5ad9d3b22e18f8e906663165dbf55b"} Sep 10 20:55:45.836317 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:45.836267 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:46.331695 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.331609 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:55:46.334734 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.334642 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c6746d97d-h9dnh"] Sep 10 20:55:46.335414 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:46.335393 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d440ea_13b5_46f8_88bd_c09d5c98e106.slice/crio-b2545d60823b3f7bfc48b6232e2bddc4faa04fb00e5484c1ed5571b2a089e41b WatchSource:0}: Error finding container b2545d60823b3f7bfc48b6232e2bddc4faa04fb00e5484c1ed5571b2a089e41b: Status 404 returned error can't find the container with id b2545d60823b3f7bfc48b6232e2bddc4faa04fb00e5484c1ed5571b2a089e41b Sep 10 20:55:46.336638 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:46.336617 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8accc516_6533_4005_9ad2_5775751aecd8.slice/crio-ed7f5a4bf73dfd3be41c5f425783bd8d2985e756f3ae31dd7ad1ee48464fc5d3 WatchSource:0}: Error finding container ed7f5a4bf73dfd3be41c5f425783bd8d2985e756f3ae31dd7ad1ee48464fc5d3: Status 404 returned error can't find the container with id ed7f5a4bf73dfd3be41c5f425783bd8d2985e756f3ae31dd7ad1ee48464fc5d3 Sep 10 20:55:46.739854 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.739823 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:46.740242 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.739892 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:55:46.741424 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.741384 2563 patch_prober.go:28] interesting pod/console-776f6c4b58-4w2rq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Sep 10 20:55:46.741550 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.741449 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-776f6c4b58-4w2rq" podUID="74916aa6-9a3d-4206-9130-f357c754c345" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Sep 10 20:55:46.787819 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.787778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerStarted","Data":"b2545d60823b3f7bfc48b6232e2bddc4faa04fb00e5484c1ed5571b2a089e41b"} Sep 10 20:55:46.789348 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.789287 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" event={"ID":"8accc516-6533-4005-9ad2-5775751aecd8","Type":"ContainerStarted","Data":"ed7f5a4bf73dfd3be41c5f425783bd8d2985e756f3ae31dd7ad1ee48464fc5d3"} Sep 10 20:55:46.792153 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.792087 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" event={"ID":"5733f1b8-d99d-4b42-94e4-250b23352806","Type":"ContainerStarted","Data":"ac3a0843c60087d56d1c4dab9832edc5df21a568f332fb13980a6754aed89c12"} Sep 10 20:55:46.795887 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.795857 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbhl" event={"ID":"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0","Type":"ContainerStarted","Data":"27a62db14e2e923e3aa0805f5cc4720be70d32413ae1f1678f0eb086252616d4"} Sep 10 20:55:46.796012 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.795952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbhl" event={"ID":"d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0","Type":"ContainerStarted","Data":"d83532f43716a8f1fb5ab263841f91a36b8a2f4f9ed10354f70f5f795c566286"} Sep 10 20:55:46.799027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.798985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" event={"ID":"742200fb-0b2b-4caa-96a3-3055f0a93f0c","Type":"ContainerStarted","Data":"5724d288846f7fd7e5a3829e04acffc65acf948699269b929d58fe701ec8702a"} Sep 10 20:55:46.799157 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.799038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" event={"ID":"742200fb-0b2b-4caa-96a3-3055f0a93f0c","Type":"ContainerStarted","Data":"3f614008ce281961107184a718974ef345fe4ac9cabc1e66c5b81d7729cb21b1"} Sep 10 20:55:46.799611 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.799069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" event={"ID":"742200fb-0b2b-4caa-96a3-3055f0a93f0c","Type":"ContainerStarted","Data":"d807bf5874f8f102e7f0440d480fabe19a94dbe748bee9b4ab162f248221698a"} Sep 10 20:55:46.816752 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.816470 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-5cnzf" podStartSLOduration=2.815591757 podStartE2EDuration="3.816448206s" totalImagesPullingTime="1.000856449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:46.815510254 +0000 UTC m=+66.030065581" watchObservedRunningTime="2026-09-10 20:55:46.816448206 +0000 UTC m=+66.031003486" Sep 10 20:55:46.835815 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.835747 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jdhxx" podStartSLOduration=2.5530494360000002 podStartE2EDuration="3.835723633s" totalImagesPullingTime="1.282674197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:46.834423159 +0000 UTC m=+66.048978448" watchObservedRunningTime="2026-09-10 20:55:46.835723633 +0000 UTC m=+66.050278922" Sep 10 20:55:46.856402 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.856281 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wtbhl" podStartSLOduration=2.665267481 podStartE2EDuration="3.856257957s" totalImagesPullingTime="1.125562929s" totalInitContainerRuntime="65.427547ms" isStatefulPod=true podCreationTimestamp="2026-09-10 20:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:46.856013469 +0000 UTC m=+66.070568783" watchObservedRunningTime="2026-09-10 20:55:46.856257957 +0000 UTC m=+66.070813247" Sep 10 20:55:46.976074 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.976037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:46.976264 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.976236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:46.978279 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.978255 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 20:55:46.978575 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.978548 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 20:55:46.989102 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.989069 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 20:55:46.989821 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:46.989799 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/933b4eae-c038-460e-8ea7-bddfcdd99f60-metrics-certs\") pod \"network-metrics-daemon-w6zkl\" (UID: \"933b4eae-c038-460e-8ea7-bddfcdd99f60\") " pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:47.000484 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.000415 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbnbh\" (UniqueName: \"kubernetes.io/projected/06855ecc-d7cb-4421-acf4-ffb6543dbc6e-kube-api-access-lbnbh\") pod \"network-check-target-s5kwb\" (UID: \"06855ecc-d7cb-4421-acf4-ffb6543dbc6e\") " pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:47.038301 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.038192 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w8kfv\"" Sep 10 20:55:47.046634 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.046604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:47.049933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.049902 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-597hv\"" Sep 10 20:55:47.058801 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.058776 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6zkl" Sep 10 20:55:47.077257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.077225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:47.079763 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.079736 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 20:55:47.090419 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.090357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3380d104-eb93-44ee-be7d-9ef83e8737c1-original-pull-secret\") pod \"global-pull-secret-syncer-86jxv\" (UID: \"3380d104-eb93-44ee-be7d-9ef83e8737c1\") " pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:47.342557 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.342476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86jxv" Sep 10 20:55:47.597022 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.596998 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s5kwb"] Sep 10 20:55:47.599373 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:47.599344 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06855ecc_d7cb_4421_acf4_ffb6543dbc6e.slice/crio-5657aa89f29b0990373cffdd25cbc8c515a41881eeecc36e5513e0a3f1f64faa WatchSource:0}: Error finding container 5657aa89f29b0990373cffdd25cbc8c515a41881eeecc36e5513e0a3f1f64faa: Status 404 returned error can't find the container with id 5657aa89f29b0990373cffdd25cbc8c515a41881eeecc36e5513e0a3f1f64faa Sep 10 20:55:47.601226 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.601200 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w6zkl"] Sep 10 20:55:47.603739 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:47.603715 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933b4eae_c038_460e_8ea7_bddfcdd99f60.slice/crio-d0548139399967813a80b617f6ac22e148ba53cc04ddf6bf8515e9ed3b54ce42 WatchSource:0}: Error finding container d0548139399967813a80b617f6ac22e148ba53cc04ddf6bf8515e9ed3b54ce42: Status 404 returned error can't find the container with id d0548139399967813a80b617f6ac22e148ba53cc04ddf6bf8515e9ed3b54ce42 Sep 10 20:55:47.634902 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.634872 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-86jxv"] Sep 10 20:55:47.637741 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:47.637707 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3380d104_eb93_44ee_be7d_9ef83e8737c1.slice/crio-9a2620329945443c136e8aa978f9b88f4bfe3e4d635364bd985b7b74be431a39 WatchSource:0}: Error finding container 9a2620329945443c136e8aa978f9b88f4bfe3e4d635364bd985b7b74be431a39: Status 404 returned error can't find the container with id 9a2620329945443c136e8aa978f9b88f4bfe3e4d635364bd985b7b74be431a39 Sep 10 20:55:47.806001 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.805966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s5kwb" event={"ID":"06855ecc-d7cb-4421-acf4-ffb6543dbc6e","Type":"ContainerStarted","Data":"5657aa89f29b0990373cffdd25cbc8c515a41881eeecc36e5513e0a3f1f64faa"} Sep 10 20:55:47.808982 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.808702 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" exitCode=0 Sep 10 20:55:47.808982 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.808778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5"} Sep 10 20:55:47.810692 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.810669 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-86jxv" event={"ID":"3380d104-eb93-44ee-be7d-9ef83e8737c1","Type":"ContainerStarted","Data":"9a2620329945443c136e8aa978f9b88f4bfe3e4d635364bd985b7b74be431a39"} Sep 10 20:55:47.811894 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.811860 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w6zkl" event={"ID":"933b4eae-c038-460e-8ea7-bddfcdd99f60","Type":"ContainerStarted","Data":"d0548139399967813a80b617f6ac22e148ba53cc04ddf6bf8515e9ed3b54ce42"} Sep 10 20:55:47.852558 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.852483 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-687f6465c8-2gsx6"] Sep 10 20:55:47.854601 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.854556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.856846 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.856824 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 20:55:47.856977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.856869 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 20:55:47.856977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.856876 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 20:55:47.856977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.856895 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 20:55:47.856977 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.856942 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wzx4b\"" Sep 10 20:55:47.857159 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.856983 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-68o24u23rq87d\"" Sep 10 20:55:47.863623 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.863599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-687f6465c8-2gsx6"] Sep 10 20:55:47.885975 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.885941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-secret-metrics-server-client-certs\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.886548 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.886432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4ce871-d805-4cd9-81f6-5774632621e5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.886715 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.886551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e4ce871-d805-4cd9-81f6-5774632621e5-metrics-server-audit-profiles\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.886790 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.886765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-secret-metrics-server-tls\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.886844 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.886802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e4ce871-d805-4cd9-81f6-5774632621e5-audit-log\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.887073 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.887007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-client-ca-bundle\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.887073 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.887068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjzfv\" (UniqueName: \"kubernetes.io/projected/3e4ce871-d805-4cd9-81f6-5774632621e5-kube-api-access-hjzfv\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.987982 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.987945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4ce871-d805-4cd9-81f6-5774632621e5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988157 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.987992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e4ce871-d805-4cd9-81f6-5774632621e5-metrics-server-audit-profiles\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988157 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.988031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-secret-metrics-server-tls\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988157 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.988058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e4ce871-d805-4cd9-81f6-5774632621e5-audit-log\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988462 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.988433 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3e4ce871-d805-4cd9-81f6-5774632621e5-audit-log\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988581 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.988487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-client-ca-bundle\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988581 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.988521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjzfv\" (UniqueName: \"kubernetes.io/projected/3e4ce871-d805-4cd9-81f6-5774632621e5-kube-api-access-hjzfv\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988717 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.988582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-secret-metrics-server-client-certs\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.988894 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.988837 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4ce871-d805-4cd9-81f6-5774632621e5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.989193 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.989171 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3e4ce871-d805-4cd9-81f6-5774632621e5-metrics-server-audit-profiles\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.991067 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.991042 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-secret-metrics-server-client-certs\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.991154 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.991138 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-secret-metrics-server-tls\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.991318 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.991293 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e4ce871-d805-4cd9-81f6-5774632621e5-client-ca-bundle\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:47.996228 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:47.996207 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjzfv\" (UniqueName: \"kubernetes.io/projected/3e4ce871-d805-4cd9-81f6-5774632621e5-kube-api-access-hjzfv\") pod \"metrics-server-687f6465c8-2gsx6\" (UID: \"3e4ce871-d805-4cd9-81f6-5774632621e5\") " pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:48.165504 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.165410 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:55:48.328032 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.327995 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm"] Sep 10 20:55:48.348959 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.348925 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f6c4b58-4w2rq"] Sep 10 20:55:48.349141 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.348979 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm"] Sep 10 20:55:48.349141 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.349059 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:48.352755 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.352641 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 20:55:48.353095 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.352641 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-67j64\"" Sep 10 20:55:48.366579 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.366535 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84688df6cf-psg77"] Sep 10 20:55:48.382789 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.382761 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84688df6cf-psg77"] Sep 10 20:55:48.382902 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.382847 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.391073 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.391047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9jcc\" (UniqueName: \"kubernetes.io/projected/c9995420-865e-4a16-8a38-4a10bc3d5d03-kube-api-access-j9jcc\") pod \"monitoring-plugin-5d85778b9d-h4wkm\" (UID: \"c9995420-865e-4a16-8a38-4a10bc3d5d03\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:48.391207 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.391122 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c9995420-865e-4a16-8a38-4a10bc3d5d03-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h4wkm\" (UID: \"c9995420-865e-4a16-8a38-4a10bc3d5d03\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:48.492235 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-serving-cert\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.492335 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-service-ca\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.492335 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-trusted-ca-bundle\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.492403 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjgg\" (UniqueName: \"kubernetes.io/projected/91803df8-e347-4232-8760-9a1509e12c34-kube-api-access-7rjgg\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.492437 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-console-config\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.492493 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-oauth-config\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.492547 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9jcc\" (UniqueName: \"kubernetes.io/projected/c9995420-865e-4a16-8a38-4a10bc3d5d03-kube-api-access-j9jcc\") pod \"monitoring-plugin-5d85778b9d-h4wkm\" (UID: \"c9995420-865e-4a16-8a38-4a10bc3d5d03\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:48.492596 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-oauth-serving-cert\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.492638 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.492623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c9995420-865e-4a16-8a38-4a10bc3d5d03-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h4wkm\" (UID: \"c9995420-865e-4a16-8a38-4a10bc3d5d03\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:48.492766 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:48.492746 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 10 20:55:48.492849 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:55:48.492838 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9995420-865e-4a16-8a38-4a10bc3d5d03-monitoring-plugin-cert podName:c9995420-865e-4a16-8a38-4a10bc3d5d03 nodeName:}" failed. No retries permitted until 2026-09-10 20:55:48.992817278 +0000 UTC m=+68.207372560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c9995420-865e-4a16-8a38-4a10bc3d5d03-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-h4wkm" (UID: "c9995420-865e-4a16-8a38-4a10bc3d5d03") : secret "monitoring-plugin-cert" not found Sep 10 20:55:48.500633 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.500607 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9jcc\" (UniqueName: \"kubernetes.io/projected/c9995420-865e-4a16-8a38-4a10bc3d5d03-kube-api-access-j9jcc\") pod \"monitoring-plugin-5d85778b9d-h4wkm\" (UID: \"c9995420-865e-4a16-8a38-4a10bc3d5d03\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:48.593405 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.593369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-serving-cert\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.593405 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.593406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-service-ca\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.593405 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.593426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-trusted-ca-bundle\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.593729 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.593559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjgg\" (UniqueName: \"kubernetes.io/projected/91803df8-e347-4232-8760-9a1509e12c34-kube-api-access-7rjgg\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.593729 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.593626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-console-config\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.593729 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.593662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-oauth-config\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.593729 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.593699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-oauth-serving-cert\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.594318 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.594289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-service-ca\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.594434 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.594363 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-console-config\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.594434 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.594426 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-trusted-ca-bundle\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.596038 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.596015 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-serving-cert\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.596123 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.596043 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-oauth-config\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.600869 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.600852 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjgg\" (UniqueName: \"kubernetes.io/projected/91803df8-e347-4232-8760-9a1509e12c34-kube-api-access-7rjgg\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.602525 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.602500 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-oauth-serving-cert\") pod \"console-84688df6cf-psg77\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.692374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.692318 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:48.707341 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.707310 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-687f6465c8-2gsx6"] Sep 10 20:55:48.748403 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.748371 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-556f85dd77-975xb"] Sep 10 20:55:48.751628 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:48.751596 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4ce871_d805_4cd9_81f6_5774632621e5.slice/crio-f19d6a9903103bc1e2f930a39273575c2216f4fca64f83713994fd346e92b21d WatchSource:0}: Error finding container f19d6a9903103bc1e2f930a39273575c2216f4fca64f83713994fd346e92b21d: Status 404 returned error can't find the container with id f19d6a9903103bc1e2f930a39273575c2216f4fca64f83713994fd346e92b21d Sep 10 20:55:48.758180 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.758157 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.760264 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.760241 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 20:55:48.760829 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.760477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 20:55:48.760829 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.760778 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 20:55:48.760994 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.760866 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 20:55:48.760994 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.760962 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 20:55:48.761827 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.761576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9bqpg\"" Sep 10 20:55:48.764411 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.764321 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-556f85dd77-975xb"] Sep 10 20:55:48.766658 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.766636 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 20:55:48.795507 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.795719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mfz\" (UniqueName: \"kubernetes.io/projected/672bed44-02cb-4b85-8c2b-2deedf53b0d3-kube-api-access-z6mfz\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.795719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.795719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-metrics-client-ca\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.795894 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-secret-telemeter-client\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.795894 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-federate-client-tls\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.795894 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-serving-certs-ca-bundle\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.796046 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.795911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-telemeter-client-tls\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.826290 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.826254 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" event={"ID":"3e4ce871-d805-4cd9-81f6-5774632621e5","Type":"ContainerStarted","Data":"f19d6a9903103bc1e2f930a39273575c2216f4fca64f83713994fd346e92b21d"} Sep 10 20:55:48.896389 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-secret-telemeter-client\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.896519 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-federate-client-tls\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.896519 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-serving-certs-ca-bundle\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.896519 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-telemeter-client-tls\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.896696 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.896696 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mfz\" (UniqueName: \"kubernetes.io/projected/672bed44-02cb-4b85-8c2b-2deedf53b0d3-kube-api-access-z6mfz\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.896696 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.896696 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.896693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-metrics-client-ca\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.897906 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.897441 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-metrics-client-ca\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.898755 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.898396 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.898755 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.898672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672bed44-02cb-4b85-8c2b-2deedf53b0d3-serving-certs-ca-bundle\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.901686 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.901639 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-secret-telemeter-client\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.902791 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.902735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.903254 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.903233 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-federate-client-tls\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.903356 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.903298 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/672bed44-02cb-4b85-8c2b-2deedf53b0d3-telemeter-client-tls\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.908704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.908638 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mfz\" (UniqueName: \"kubernetes.io/projected/672bed44-02cb-4b85-8c2b-2deedf53b0d3-kube-api-access-z6mfz\") pod \"telemeter-client-556f85dd77-975xb\" (UID: \"672bed44-02cb-4b85-8c2b-2deedf53b0d3\") " pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:48.998231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:48.997697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c9995420-865e-4a16-8a38-4a10bc3d5d03-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h4wkm\" (UID: \"c9995420-865e-4a16-8a38-4a10bc3d5d03\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:49.001994 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.001912 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c9995420-865e-4a16-8a38-4a10bc3d5d03-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-h4wkm\" (UID: \"c9995420-865e-4a16-8a38-4a10bc3d5d03\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:49.049409 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.049336 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84688df6cf-psg77"] Sep 10 20:55:49.057696 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:49.057665 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91803df8_e347_4232_8760_9a1509e12c34.slice/crio-7e8daf7072af6b6417cf963c263c86e6a8f482330c993e080bf1017e3aa4fa4b WatchSource:0}: Error finding container 7e8daf7072af6b6417cf963c263c86e6a8f482330c993e080bf1017e3aa4fa4b: Status 404 returned error can't find the container with id 7e8daf7072af6b6417cf963c263c86e6a8f482330c993e080bf1017e3aa4fa4b Sep 10 20:55:49.093657 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.093454 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" Sep 10 20:55:49.264063 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.263747 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:49.443335 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.443235 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-556f85dd77-975xb"] Sep 10 20:55:49.450035 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:49.450004 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672bed44_02cb_4b85_8c2b_2deedf53b0d3.slice/crio-d29f3039aedfcd0e86806baedc4202282e3d57e9e36e08e26e9d5824cc8f90fa WatchSource:0}: Error finding container d29f3039aedfcd0e86806baedc4202282e3d57e9e36e08e26e9d5824cc8f90fa: Status 404 returned error can't find the container with id d29f3039aedfcd0e86806baedc4202282e3d57e9e36e08e26e9d5824cc8f90fa Sep 10 20:55:49.594718 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.594622 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm"] Sep 10 20:55:49.841658 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.841613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84688df6cf-psg77" event={"ID":"91803df8-e347-4232-8760-9a1509e12c34","Type":"ContainerStarted","Data":"f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d"} Sep 10 20:55:49.842199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.841723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84688df6cf-psg77" event={"ID":"91803df8-e347-4232-8760-9a1509e12c34","Type":"ContainerStarted","Data":"7e8daf7072af6b6417cf963c263c86e6a8f482330c993e080bf1017e3aa4fa4b"} Sep 10 20:55:49.850199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.850065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" event={"ID":"672bed44-02cb-4b85-8c2b-2deedf53b0d3","Type":"ContainerStarted","Data":"d29f3039aedfcd0e86806baedc4202282e3d57e9e36e08e26e9d5824cc8f90fa"} Sep 10 20:55:49.858025 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.857839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" event={"ID":"8accc516-6533-4005-9ad2-5775751aecd8","Type":"ContainerStarted","Data":"79de1b59916d1cb667306cc5a8a7aef29463bf6ec296446760b730b92d32be37"} Sep 10 20:55:49.858025 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.857919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" event={"ID":"8accc516-6533-4005-9ad2-5775751aecd8","Type":"ContainerStarted","Data":"70c143c1bb918fbe18148e785f1ff14a86576ff4e8c35a50aca5cba683817023"} Sep 10 20:55:49.858025 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.857958 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" event={"ID":"8accc516-6533-4005-9ad2-5775751aecd8","Type":"ContainerStarted","Data":"bd4ee7d45b5ef171344a8d494c19a8841746fb8d33a66cc11e7e9b5f68023f9c"} Sep 10 20:55:49.898176 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.897677 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84688df6cf-psg77" podStartSLOduration=1.897651878 podStartE2EDuration="1.897651878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:49.861891623 +0000 UTC m=+69.076446912" watchObservedRunningTime="2026-09-10 20:55:49.897651878 +0000 UTC m=+69.112207169" Sep 10 20:55:49.898176 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.897939 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:55:49.906892 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.906864 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.911207 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.911438 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.911767 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dgm2kkj8tn0ki\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.912004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.912768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.913162 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5wjbr\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.913390 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.913706 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 20:55:49.914017 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.913852 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 20:55:49.916593 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.915492 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 20:55:49.916593 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.915734 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 20:55:49.916593 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.916166 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 20:55:49.916593 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.916350 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 20:55:49.917071 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.916904 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 20:55:49.925593 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.921849 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 20:55:49.932780 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.932100 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 20:55:49.934933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:49.934840 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:55:50.015325 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015518 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015518 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015518 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015518 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015518 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnv69\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-kube-api-access-tnv69\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.015859 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.016262 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.016262 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.016262 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.016262 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.015981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.016262 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.016005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.117979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.118008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnv69\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-kube-api-access-tnv69\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119007 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.118039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.118060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.118082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.118133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.119918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.119220 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.127360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.120726 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.127360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.122516 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.127360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.125843 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.127360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.126127 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.127360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.127047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.127360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.127102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.128749 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.128197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.128749 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.128702 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.132782 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.132738 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.132944 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.132923 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.133547 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.133071 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.133547 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.133130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.133547 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.133514 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.133547 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.133518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.134079 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.134015 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.134149 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.134014 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.134481 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.134460 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.136441 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.136417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnv69\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-kube-api-access-tnv69\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.139239 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.139051 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.232665 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.232296 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:55:50.867399 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.867327 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" event={"ID":"c9995420-865e-4a16-8a38-4a10bc3d5d03","Type":"ContainerStarted","Data":"bf60b6ea886a7ae3e8d8cc3aed1a18fd5fe800c54de2ad9d39ab7b91c368c6a4"} Sep 10 20:55:50.922706 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.922671 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:50.923512 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.923438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:50.931523 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:50.930668 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:51.876283 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:51.876192 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:55:53.455870 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:53.455817 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:55:54.917171 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:54.917098 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11b87b6_e6be_48df_8284_e8e3cb1d5dbe.slice/crio-4f4da7fa1df10dc4b8d931ba8fe0a871578d04602c88e1729da7249c36c23624 WatchSource:0}: Error finding container 4f4da7fa1df10dc4b8d931ba8fe0a871578d04602c88e1729da7249c36c23624: Status 404 returned error can't find the container with id 4f4da7fa1df10dc4b8d931ba8fe0a871578d04602c88e1729da7249c36c23624 Sep 10 20:55:55.895602 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.895547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s5kwb" event={"ID":"06855ecc-d7cb-4421-acf4-ffb6543dbc6e","Type":"ContainerStarted","Data":"822a805976f2576cfaf2248f505b6a284ca980e44d6de10cec16c76fca875b1f"} Sep 10 20:55:55.895774 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.895680 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:55:55.897919 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.897891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" event={"ID":"c9995420-865e-4a16-8a38-4a10bc3d5d03","Type":"ContainerStarted","Data":"835a0046c8f6a46f11672f35332c988d6496cd0105b2839c74bb5fef76d4b594"} Sep 10 20:55:55.898190 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.898028 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:55.907635 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.907599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerStarted","Data":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} Sep 10 20:55:55.907790 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.907709 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerStarted","Data":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} Sep 10 20:55:55.907790 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.907747 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerStarted","Data":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} Sep 10 20:55:55.907790 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.907777 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerStarted","Data":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} Sep 10 20:55:55.907925 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.907812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerStarted","Data":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} Sep 10 20:55:55.907925 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.907838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerStarted","Data":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} Sep 10 20:55:55.909548 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.909523 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" Sep 10 20:55:55.910289 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.910259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" event={"ID":"672bed44-02cb-4b85-8c2b-2deedf53b0d3","Type":"ContainerStarted","Data":"f31a6099b09a336199cec4931e334817e4933fbfeb6f3671e297de70b512d28b"} Sep 10 20:55:55.910408 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.910313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" event={"ID":"672bed44-02cb-4b85-8c2b-2deedf53b0d3","Type":"ContainerStarted","Data":"2973d3a014f097aa16c59a94cd17e0f5cafc5cfac43309bbc4d7789f87edefe4"} Sep 10 20:55:55.910408 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.910343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" event={"ID":"672bed44-02cb-4b85-8c2b-2deedf53b0d3","Type":"ContainerStarted","Data":"f6e4b20bb5647e90d0193071e79b7a750fe8cfdb45d9f2c877419d8ffc0ec817"} Sep 10 20:55:55.912275 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.912229 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s5kwb" podStartSLOduration=67.546813327 podStartE2EDuration="1m14.912211756s" totalImagesPullingTime="7.365398429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:55.911744453 +0000 UTC m=+75.126299743" watchObservedRunningTime="2026-09-10 20:55:55.912211756 +0000 UTC m=+75.126767047" Sep 10 20:55:55.914212 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.914188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" event={"ID":"8accc516-6533-4005-9ad2-5775751aecd8","Type":"ContainerStarted","Data":"e0aabd9f4d939e79ca3e51e23e07842c0fb6dbe938bac81edbdb052473f268b6"} Sep 10 20:55:55.914314 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.914284 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" event={"ID":"8accc516-6533-4005-9ad2-5775751aecd8","Type":"ContainerStarted","Data":"24f4156a7c086097761f5ca5a98cc88458e2d0b4258864bb58f77ef8511b4bca"} Sep 10 20:55:55.914385 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.914329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" event={"ID":"8accc516-6533-4005-9ad2-5775751aecd8","Type":"ContainerStarted","Data":"1600d3ed0e70b440adaf83926379a055b17a526b3ab8ddc2d7e77295d480d383"} Sep 10 20:55:55.914623 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.914485 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:55.916149 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.916121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" event={"ID":"3e4ce871-d805-4cd9-81f6-5774632621e5","Type":"ContainerStarted","Data":"ac92c0fd0d69bc5c790b3a27b9213b4a704956e2c6ac23a9b912a2be104a5d37"} Sep 10 20:55:55.918299 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.918278 2563 generic.go:356] "Generic (PLEG): container finished" podID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" exitCode=0 Sep 10 20:55:55.918678 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.918362 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f"} Sep 10 20:55:55.918678 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.918436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerStarted","Data":"4f4da7fa1df10dc4b8d931ba8fe0a871578d04602c88e1729da7249c36c23624"} Sep 10 20:55:55.920417 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.920395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-86jxv" event={"ID":"3380d104-eb93-44ee-be7d-9ef83e8737c1","Type":"ContainerStarted","Data":"daed3cd38e08ecae4ce3fa2f0108e703311a85b4c115e142038d1e4f416e1952"} Sep 10 20:55:55.922253 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.921800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" Sep 10 20:55:55.923049 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.923029 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w6zkl" event={"ID":"933b4eae-c038-460e-8ea7-bddfcdd99f60","Type":"ContainerStarted","Data":"5bfe1f91239861ab7b188818b8c1e571ace9ca1982202f1d70fb72cc9a7c669a"} Sep 10 20:55:55.923139 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.923070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w6zkl" event={"ID":"933b4eae-c038-460e-8ea7-bddfcdd99f60","Type":"ContainerStarted","Data":"cd1d54f85ec18da8b03b23a0ee09920d273fe90056148964651e5b0eb34cf305"} Sep 10 20:55:55.936211 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.936165 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.129028157 podStartE2EDuration="11.936149296s" totalImagesPullingTime="7.787575933s" totalInitContainerRuntime="19.545206ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:55.935078379 +0000 UTC m=+75.149633690" watchObservedRunningTime="2026-09-10 20:55:55.936149296 +0000 UTC m=+75.150704583" Sep 10 20:55:55.950528 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.950478 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-h4wkm" podStartSLOduration=3.117862275 podStartE2EDuration="7.950465594s" totalImagesPullingTime="4.832603319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:55.950198437 +0000 UTC m=+75.164753725" watchObservedRunningTime="2026-09-10 20:55:55.950465594 +0000 UTC m=+75.165020882" Sep 10 20:55:55.972842 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.972785 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-556f85dd77-975xb" podStartSLOduration=2.457698848 podStartE2EDuration="7.972762822s" totalImagesPullingTime="5.515063974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:55.969962785 +0000 UTC m=+75.184518074" watchObservedRunningTime="2026-09-10 20:55:55.972762822 +0000 UTC m=+75.187318111" Sep 10 20:55:55.985956 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:55.985884 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" podStartSLOduration=2.781651107 podStartE2EDuration="8.985861789s" totalImagesPullingTime="6.204210682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:55.985639301 +0000 UTC m=+75.200194590" watchObservedRunningTime="2026-09-10 20:55:55.985861789 +0000 UTC m=+75.200417080" Sep 10 20:55:56.039022 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.038967 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c6746d97d-h9dnh" podStartSLOduration=2.809192808 podStartE2EDuration="11.038949571s" totalImagesPullingTime="8.229756763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:56.03720427 +0000 UTC m=+75.251759615" watchObservedRunningTime="2026-09-10 20:55:56.038949571 +0000 UTC m=+75.253504859" Sep 10 20:55:56.054161 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.054094 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w6zkl" podStartSLOduration=68.075979078 podStartE2EDuration="1m15.05407111s" totalImagesPullingTime="6.978092032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:56.052034583 +0000 UTC m=+75.266589871" watchObservedRunningTime="2026-09-10 20:55:56.05407111 +0000 UTC m=+75.268626400" Sep 10 20:55:56.069145 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.069112 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84688df6cf-psg77"] Sep 10 20:55:56.081500 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.081452 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-86jxv" podStartSLOduration=66.731862226 podStartE2EDuration="1m14.081435123s" totalImagesPullingTime="7.349572897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:56.078150018 +0000 UTC m=+75.292705306" watchObservedRunningTime="2026-09-10 20:55:56.081435123 +0000 UTC m=+75.295990470" Sep 10 20:55:56.129923 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.129886 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-588596f558-pfzd2"] Sep 10 20:55:56.134653 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.134631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.150486 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.150407 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588596f558-pfzd2"] Sep 10 20:55:56.191657 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.191620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-trusted-ca-bundle\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.191822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.191680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-oauth-config\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.191822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.191704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-console-config\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.191822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.191727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-oauth-serving-cert\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.191822 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.191748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzmvd\" (UniqueName: \"kubernetes.io/projected/842066df-e494-45bd-a3af-4531689a0c03-kube-api-access-qzmvd\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.192014 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.191833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-service-ca\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.192014 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.191880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-serving-cert\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.292783 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.292748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-trusted-ca-bundle\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.292991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.292794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-oauth-config\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.292991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.292813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-console-config\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.292991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.292832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-oauth-serving-cert\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.292991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.292849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzmvd\" (UniqueName: \"kubernetes.io/projected/842066df-e494-45bd-a3af-4531689a0c03-kube-api-access-qzmvd\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.292991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.292882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-service-ca\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.292991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.292929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-serving-cert\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.293609 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.293553 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-oauth-serving-cert\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.293729 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.293707 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-console-config\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.293777 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.293757 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-service-ca\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.293866 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.293844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-trusted-ca-bundle\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.295436 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.295409 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-oauth-config\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.295530 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.295442 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-serving-cert\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.300792 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.300770 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzmvd\" (UniqueName: \"kubernetes.io/projected/842066df-e494-45bd-a3af-4531689a0c03-kube-api-access-qzmvd\") pod \"console-588596f558-pfzd2\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.444269 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.444182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:55:56.729072 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.729038 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588596f558-pfzd2"] Sep 10 20:55:56.734894 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:55:56.734858 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842066df_e494_45bd_a3af_4531689a0c03.slice/crio-7fe96ac2135eef3376bd3fb76a6db02c30db157f7ac89c9268e18f1fa547bb16 WatchSource:0}: Error finding container 7fe96ac2135eef3376bd3fb76a6db02c30db157f7ac89c9268e18f1fa547bb16: Status 404 returned error can't find the container with id 7fe96ac2135eef3376bd3fb76a6db02c30db157f7ac89c9268e18f1fa547bb16 Sep 10 20:55:56.931857 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.931809 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588596f558-pfzd2" event={"ID":"842066df-e494-45bd-a3af-4531689a0c03","Type":"ContainerStarted","Data":"b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9"} Sep 10 20:55:56.932297 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.931875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588596f558-pfzd2" event={"ID":"842066df-e494-45bd-a3af-4531689a0c03","Type":"ContainerStarted","Data":"7fe96ac2135eef3376bd3fb76a6db02c30db157f7ac89c9268e18f1fa547bb16"} Sep 10 20:55:56.949636 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:56.949578 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-588596f558-pfzd2" podStartSLOduration=0.94954535 podStartE2EDuration="949.54535ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:56.947716172 +0000 UTC m=+76.162271461" watchObservedRunningTime="2026-09-10 20:55:56.94954535 +0000 UTC m=+76.164100637" Sep 10 20:55:58.692777 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:58.692736 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:55:59.948893 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:59.948809 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerStarted","Data":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} Sep 10 20:55:59.948893 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:59.948874 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerStarted","Data":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} Sep 10 20:55:59.949294 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:59.948933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerStarted","Data":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} Sep 10 20:55:59.949294 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:59.948959 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerStarted","Data":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} Sep 10 20:55:59.949294 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:59.948982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerStarted","Data":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} Sep 10 20:55:59.949294 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:59.949018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerStarted","Data":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} Sep 10 20:55:59.975892 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:55:59.975838 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.533269529 podStartE2EDuration="10.975821275s" totalImagesPullingTime="3.392440359s" totalInitContainerRuntime="50.111387ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:55:59.974337236 +0000 UTC m=+79.188892536" watchObservedRunningTime="2026-09-10 20:55:59.975821275 +0000 UTC m=+79.190376579" Sep 10 20:56:00.232750 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:00.232717 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:56:06.445273 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:06.445148 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:56:06.445273 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:06.445207 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:56:06.449982 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:06.449959 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:56:06.985325 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:06.985296 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:56:07.033683 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:07.033649 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c698dbbc-bxt5k"] Sep 10 20:56:08.165954 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:08.165908 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:56:08.166342 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:08.165980 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:56:13.376000 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.375939 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-776f6c4b58-4w2rq" podUID="74916aa6-9a3d-4206-9130-f357c754c345" containerName="console" containerID="cri-o://83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d" gracePeriod=15 Sep 10 20:56:13.644685 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.644614 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:56:13.767509 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767477 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-oauth-serving-cert\") pod \"74916aa6-9a3d-4206-9130-f357c754c345\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " Sep 10 20:56:13.767744 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767518 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-service-ca\") pod \"74916aa6-9a3d-4206-9130-f357c754c345\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " Sep 10 20:56:13.767744 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767558 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-console-config\") pod \"74916aa6-9a3d-4206-9130-f357c754c345\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " Sep 10 20:56:13.767744 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767709 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb9b8\" (UniqueName: \"kubernetes.io/projected/74916aa6-9a3d-4206-9130-f357c754c345-kube-api-access-nb9b8\") pod \"74916aa6-9a3d-4206-9130-f357c754c345\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " Sep 10 20:56:13.767911 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767760 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-serving-cert\") pod \"74916aa6-9a3d-4206-9130-f357c754c345\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " Sep 10 20:56:13.767911 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767835 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-oauth-config\") pod \"74916aa6-9a3d-4206-9130-f357c754c345\" (UID: \"74916aa6-9a3d-4206-9130-f357c754c345\") " Sep 10 20:56:13.768002 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767935 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-service-ca" (OuterVolumeSpecName: "service-ca") pod "74916aa6-9a3d-4206-9130-f357c754c345" (UID: "74916aa6-9a3d-4206-9130-f357c754c345"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:13.768002 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767970 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-console-config" (OuterVolumeSpecName: "console-config") pod "74916aa6-9a3d-4206-9130-f357c754c345" (UID: "74916aa6-9a3d-4206-9130-f357c754c345"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:13.768116 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.767999 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74916aa6-9a3d-4206-9130-f357c754c345" (UID: "74916aa6-9a3d-4206-9130-f357c754c345"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:13.768212 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.768194 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-console-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:13.768259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.768214 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-oauth-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:13.768259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.768232 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74916aa6-9a3d-4206-9130-f357c754c345-service-ca\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:13.770139 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.770102 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74916aa6-9a3d-4206-9130-f357c754c345" (UID: "74916aa6-9a3d-4206-9130-f357c754c345"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:56:13.770253 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.770135 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74916aa6-9a3d-4206-9130-f357c754c345-kube-api-access-nb9b8" (OuterVolumeSpecName: "kube-api-access-nb9b8") pod "74916aa6-9a3d-4206-9130-f357c754c345" (UID: "74916aa6-9a3d-4206-9130-f357c754c345"). InnerVolumeSpecName "kube-api-access-nb9b8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:56:13.770253 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.770173 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74916aa6-9a3d-4206-9130-f357c754c345" (UID: "74916aa6-9a3d-4206-9130-f357c754c345"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:56:13.869324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.869293 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb9b8\" (UniqueName: \"kubernetes.io/projected/74916aa6-9a3d-4206-9130-f357c754c345-kube-api-access-nb9b8\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:13.869324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.869318 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:13.869324 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:13.869329 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74916aa6-9a3d-4206-9130-f357c754c345-console-oauth-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:14.013545 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.013510 2563 generic.go:356] "Generic (PLEG): container finished" podID="74916aa6-9a3d-4206-9130-f357c754c345" containerID="83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d" exitCode=0 Sep 10 20:56:14.013719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.013555 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f6c4b58-4w2rq" Sep 10 20:56:14.013719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.013556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f6c4b58-4w2rq" event={"ID":"74916aa6-9a3d-4206-9130-f357c754c345","Type":"ContainerDied","Data":"83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d"} Sep 10 20:56:14.013719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.013625 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f6c4b58-4w2rq" event={"ID":"74916aa6-9a3d-4206-9130-f357c754c345","Type":"ContainerDied","Data":"c1bed3dbf6a1cd5399c99cf35a4790b07e218ddecc67fb91853ed8e6a17e67bd"} Sep 10 20:56:14.013719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.013652 2563 scope.go:117] "RemoveContainer" containerID="83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d" Sep 10 20:56:14.023637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.023615 2563 scope.go:117] "RemoveContainer" containerID="83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d" Sep 10 20:56:14.023923 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:56:14.023904 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d\": container with ID starting with 83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d not found: ID does not exist" containerID="83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d" Sep 10 20:56:14.023974 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.023932 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d"} err="failed to get container status \"83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d\": rpc error: code = NotFound desc = could not find container \"83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d\": container with ID starting with 83a4c26a9aba96d4018809d61b938a4b9caaaf420efbfef5fd997babbe28ca5d not found: ID does not exist" Sep 10 20:56:14.034045 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.034010 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f6c4b58-4w2rq"] Sep 10 20:56:14.040642 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:14.040621 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-776f6c4b58-4w2rq"] Sep 10 20:56:15.325520 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:15.325488 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74916aa6-9a3d-4206-9130-f357c754c345" path="/var/lib/kubelet/pods/74916aa6-9a3d-4206-9130-f357c754c345/volumes" Sep 10 20:56:21.088620 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.088577 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84688df6cf-psg77" podUID="91803df8-e347-4232-8760-9a1509e12c34" containerName="console" containerID="cri-o://f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d" gracePeriod=15 Sep 10 20:56:21.365902 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.365822 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:56:21.430234 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430197 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-console-config\") pod \"91803df8-e347-4232-8760-9a1509e12c34\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " Sep 10 20:56:21.430414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430280 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rjgg\" (UniqueName: \"kubernetes.io/projected/91803df8-e347-4232-8760-9a1509e12c34-kube-api-access-7rjgg\") pod \"91803df8-e347-4232-8760-9a1509e12c34\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " Sep 10 20:56:21.430414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430315 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-serving-cert\") pod \"91803df8-e347-4232-8760-9a1509e12c34\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " Sep 10 20:56:21.430414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430344 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-service-ca\") pod \"91803df8-e347-4232-8760-9a1509e12c34\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " Sep 10 20:56:21.430414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430362 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-oauth-serving-cert\") pod \"91803df8-e347-4232-8760-9a1509e12c34\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " Sep 10 20:56:21.430414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430387 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-trusted-ca-bundle\") pod \"91803df8-e347-4232-8760-9a1509e12c34\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " Sep 10 20:56:21.430414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430410 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-oauth-config\") pod \"91803df8-e347-4232-8760-9a1509e12c34\" (UID: \"91803df8-e347-4232-8760-9a1509e12c34\") " Sep 10 20:56:21.430800 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430770 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-console-config" (OuterVolumeSpecName: "console-config") pod "91803df8-e347-4232-8760-9a1509e12c34" (UID: "91803df8-e347-4232-8760-9a1509e12c34"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:21.430864 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430826 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-service-ca" (OuterVolumeSpecName: "service-ca") pod "91803df8-e347-4232-8760-9a1509e12c34" (UID: "91803df8-e347-4232-8760-9a1509e12c34"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:21.430907 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430831 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91803df8-e347-4232-8760-9a1509e12c34" (UID: "91803df8-e347-4232-8760-9a1509e12c34"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:21.430907 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.430862 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91803df8-e347-4232-8760-9a1509e12c34" (UID: "91803df8-e347-4232-8760-9a1509e12c34"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:21.432719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.432693 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91803df8-e347-4232-8760-9a1509e12c34-kube-api-access-7rjgg" (OuterVolumeSpecName: "kube-api-access-7rjgg") pod "91803df8-e347-4232-8760-9a1509e12c34" (UID: "91803df8-e347-4232-8760-9a1509e12c34"). InnerVolumeSpecName "kube-api-access-7rjgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:56:21.432719 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.432701 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91803df8-e347-4232-8760-9a1509e12c34" (UID: "91803df8-e347-4232-8760-9a1509e12c34"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:56:21.432861 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.432755 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91803df8-e347-4232-8760-9a1509e12c34" (UID: "91803df8-e347-4232-8760-9a1509e12c34"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:56:21.531940 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.531893 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:21.531940 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.531932 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-service-ca\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:21.531940 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.531943 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-oauth-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:21.531940 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.531951 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-trusted-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:21.532217 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.531960 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91803df8-e347-4232-8760-9a1509e12c34-console-oauth-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:21.532217 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.531968 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91803df8-e347-4232-8760-9a1509e12c34-console-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:21.532217 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:21.531975 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rjgg\" (UniqueName: \"kubernetes.io/projected/91803df8-e347-4232-8760-9a1509e12c34-kube-api-access-7rjgg\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:22.050399 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.050364 2563 generic.go:356] "Generic (PLEG): container finished" podID="91803df8-e347-4232-8760-9a1509e12c34" containerID="f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d" exitCode=0 Sep 10 20:56:22.050594 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.050422 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84688df6cf-psg77" Sep 10 20:56:22.050594 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.050452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84688df6cf-psg77" event={"ID":"91803df8-e347-4232-8760-9a1509e12c34","Type":"ContainerDied","Data":"f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d"} Sep 10 20:56:22.050594 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.050524 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84688df6cf-psg77" event={"ID":"91803df8-e347-4232-8760-9a1509e12c34","Type":"ContainerDied","Data":"7e8daf7072af6b6417cf963c263c86e6a8f482330c993e080bf1017e3aa4fa4b"} Sep 10 20:56:22.050594 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.050549 2563 scope.go:117] "RemoveContainer" containerID="f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d" Sep 10 20:56:22.059436 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.059416 2563 scope.go:117] "RemoveContainer" containerID="f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d" Sep 10 20:56:22.059719 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:56:22.059699 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d\": container with ID starting with f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d not found: ID does not exist" containerID="f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d" Sep 10 20:56:22.059795 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.059726 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d"} err="failed to get container status \"f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d\": rpc error: code = NotFound desc = could not find container \"f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d\": container with ID starting with f85ef5abb74384b743c40ce50f29d4d04a376e5320ab19221b0357d607e2ae9d not found: ID does not exist" Sep 10 20:56:22.070347 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.070324 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84688df6cf-psg77"] Sep 10 20:56:22.073914 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:22.073894 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84688df6cf-psg77"] Sep 10 20:56:23.325944 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:23.325910 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91803df8-e347-4232-8760-9a1509e12c34" path="/var/lib/kubelet/pods/91803df8-e347-4232-8760-9a1509e12c34/volumes" Sep 10 20:56:26.935526 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:26.935492 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s5kwb" Sep 10 20:56:28.171154 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:28.171124 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:56:28.174947 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:28.174922 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-687f6465c8-2gsx6" Sep 10 20:56:32.053589 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.053528 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59c698dbbc-bxt5k" podUID="b5b76eb2-e275-4931-b6e4-903892724d0d" containerName="console" containerID="cri-o://4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c" gracePeriod=15 Sep 10 20:56:32.300039 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.300016 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:56:32.326979 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.326902 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-console-config\") pod \"b5b76eb2-e275-4931-b6e4-903892724d0d\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " Sep 10 20:56:32.326979 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.326945 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-oauth-config\") pod \"b5b76eb2-e275-4931-b6e4-903892724d0d\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " Sep 10 20:56:32.327166 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.326989 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl62r\" (UniqueName: \"kubernetes.io/projected/b5b76eb2-e275-4931-b6e4-903892724d0d-kube-api-access-zl62r\") pod \"b5b76eb2-e275-4931-b6e4-903892724d0d\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " Sep 10 20:56:32.327230 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327160 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-service-ca\") pod \"b5b76eb2-e275-4931-b6e4-903892724d0d\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " Sep 10 20:56:32.327230 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327203 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-serving-cert\") pod \"b5b76eb2-e275-4931-b6e4-903892724d0d\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " Sep 10 20:56:32.327327 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327241 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-oauth-serving-cert\") pod \"b5b76eb2-e275-4931-b6e4-903892724d0d\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " Sep 10 20:56:32.327327 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327302 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-trusted-ca-bundle\") pod \"b5b76eb2-e275-4931-b6e4-903892724d0d\" (UID: \"b5b76eb2-e275-4931-b6e4-903892724d0d\") " Sep 10 20:56:32.327418 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327317 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-console-config" (OuterVolumeSpecName: "console-config") pod "b5b76eb2-e275-4931-b6e4-903892724d0d" (UID: "b5b76eb2-e275-4931-b6e4-903892724d0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:32.327698 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327667 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-console-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:32.327698 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327548 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5b76eb2-e275-4931-b6e4-903892724d0d" (UID: "b5b76eb2-e275-4931-b6e4-903892724d0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:32.327876 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327758 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5b76eb2-e275-4931-b6e4-903892724d0d" (UID: "b5b76eb2-e275-4931-b6e4-903892724d0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:32.327934 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.327917 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b5b76eb2-e275-4931-b6e4-903892724d0d" (UID: "b5b76eb2-e275-4931-b6e4-903892724d0d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:56:32.329381 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.329359 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5b76eb2-e275-4931-b6e4-903892724d0d" (UID: "b5b76eb2-e275-4931-b6e4-903892724d0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:56:32.329913 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.329882 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5b76eb2-e275-4931-b6e4-903892724d0d" (UID: "b5b76eb2-e275-4931-b6e4-903892724d0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:56:32.329987 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.329918 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b76eb2-e275-4931-b6e4-903892724d0d-kube-api-access-zl62r" (OuterVolumeSpecName: "kube-api-access-zl62r") pod "b5b76eb2-e275-4931-b6e4-903892724d0d" (UID: "b5b76eb2-e275-4931-b6e4-903892724d0d"). InnerVolumeSpecName "kube-api-access-zl62r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:56:32.429161 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.429122 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-oauth-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:32.429161 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.429155 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl62r\" (UniqueName: \"kubernetes.io/projected/b5b76eb2-e275-4931-b6e4-903892724d0d-kube-api-access-zl62r\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:32.429161 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.429169 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-service-ca\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:32.429655 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.429180 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5b76eb2-e275-4931-b6e4-903892724d0d-console-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:32.429655 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.429194 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-oauth-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:32.429655 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:32.429205 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5b76eb2-e275-4931-b6e4-903892724d0d-trusted-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:56:33.099051 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.099012 2563 generic.go:356] "Generic (PLEG): container finished" podID="b5b76eb2-e275-4931-b6e4-903892724d0d" containerID="4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c" exitCode=0 Sep 10 20:56:33.099429 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.099065 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c698dbbc-bxt5k" Sep 10 20:56:33.099429 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.099071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c698dbbc-bxt5k" event={"ID":"b5b76eb2-e275-4931-b6e4-903892724d0d","Type":"ContainerDied","Data":"4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c"} Sep 10 20:56:33.099429 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.099120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c698dbbc-bxt5k" event={"ID":"b5b76eb2-e275-4931-b6e4-903892724d0d","Type":"ContainerDied","Data":"82457431875fb2776f73898426fa973a78e10ffca1debe3693872d678d072f0e"} Sep 10 20:56:33.099429 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.099147 2563 scope.go:117] "RemoveContainer" containerID="4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c" Sep 10 20:56:33.108661 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.108639 2563 scope.go:117] "RemoveContainer" containerID="4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c" Sep 10 20:56:33.108934 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:56:33.108916 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c\": container with ID starting with 4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c not found: ID does not exist" containerID="4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c" Sep 10 20:56:33.109005 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.108941 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c"} err="failed to get container status \"4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c\": rpc error: code = NotFound desc = could not find container \"4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c\": container with ID starting with 4a8f074b0b78a8359c81c03f38c9a7e39fd38a684e10cc35d0ba8a924b8fbc3c not found: ID does not exist" Sep 10 20:56:33.122434 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.122402 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c698dbbc-bxt5k"] Sep 10 20:56:33.127717 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.127693 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c698dbbc-bxt5k"] Sep 10 20:56:33.325476 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:33.325429 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5b76eb2-e275-4931-b6e4-903892724d0d" path="/var/lib/kubelet/pods/b5b76eb2-e275-4931-b6e4-903892724d0d/volumes" Sep 10 20:56:50.233196 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:50.233145 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:56:50.253467 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:50.253438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:56:51.196777 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:56:51.196748 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:03.917116 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:03.917081 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:57:03.917637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:03.917362 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="alertmanager" containerID="cri-o://f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" gracePeriod=120 Sep 10 20:57:03.917637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:03.917442 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-web" containerID="cri-o://9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" gracePeriod=120 Sep 10 20:57:03.917637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:03.917491 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy" containerID="cri-o://9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" gracePeriod=120 Sep 10 20:57:03.917637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:03.917437 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-metric" containerID="cri-o://5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" gracePeriod=120 Sep 10 20:57:03.917637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:03.917525 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="prom-label-proxy" containerID="cri-o://32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" gracePeriod=120 Sep 10 20:57:03.917637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:03.917537 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="config-reloader" containerID="cri-o://7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" gracePeriod=120 Sep 10 20:57:04.167838 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.167778 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.206491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206461 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-tls-assets\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.206704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206504 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.206704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206547 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.206704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206587 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdmht\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-kube-api-access-vdmht\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.206704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206623 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-metrics-client-ca\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.206704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206647 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-web\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.206704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206675 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-volume\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.207012 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206709 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-main-db\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.207012 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206732 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-web-config\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.207012 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206773 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.207012 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206802 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-cluster-tls-config\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.207012 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.206853 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-out\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.207336 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.207301 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:04.207415 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.207369 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls\") pod \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\" (UID: \"f5d440ea-13b5-46f8-88bd-c09d5c98e106\") " Sep 10 20:57:04.208002 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.207706 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-metrics-client-ca\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.208002 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.207871 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 20:57:04.211202 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.211165 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:04.213933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.213695 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:57:04.214136 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.213732 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-out" (OuterVolumeSpecName: "config-out") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 20:57:04.224257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.222005 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:04.224257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.222055 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:04.224257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.222785 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-volume" (OuterVolumeSpecName: "config-volume") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:04.224257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.223029 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:04.224257 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.224089 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-kube-api-access-vdmht" (OuterVolumeSpecName: "kube-api-access-vdmht") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "kube-api-access-vdmht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:57:04.225037 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.224999 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:04.230414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.230364 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:04.235003 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.234970 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" exitCode=0 Sep 10 20:57:04.235003 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235000 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" exitCode=0 Sep 10 20:57:04.235003 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235007 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" exitCode=0 Sep 10 20:57:04.235231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235013 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" exitCode=0 Sep 10 20:57:04.235231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235018 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" exitCode=0 Sep 10 20:57:04.235231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235024 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" exitCode=0 Sep 10 20:57:04.235231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235050 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} Sep 10 20:57:04.235231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235092 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.235231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235187 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} Sep 10 20:57:04.235231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235231 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} Sep 10 20:57:04.235679 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235249 2563 scope.go:117] "RemoveContainer" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.235679 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} Sep 10 20:57:04.235679 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235321 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} Sep 10 20:57:04.235679 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235363 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} Sep 10 20:57:04.235679 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.235405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5d440ea-13b5-46f8-88bd-c09d5c98e106","Type":"ContainerDied","Data":"b2545d60823b3f7bfc48b6232e2bddc4faa04fb00e5484c1ed5571b2a089e41b"} Sep 10 20:57:04.236444 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.236240 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-web-config" (OuterVolumeSpecName: "web-config") pod "f5d440ea-13b5-46f8-88bd-c09d5c98e106" (UID: "f5d440ea-13b5-46f8-88bd-c09d5c98e106"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:04.243672 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.243642 2563 scope.go:117] "RemoveContainer" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.251545 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.251524 2563 scope.go:117] "RemoveContainer" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.258360 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.258338 2563 scope.go:117] "RemoveContainer" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.264939 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.264921 2563 scope.go:117] "RemoveContainer" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.271712 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.271681 2563 scope.go:117] "RemoveContainer" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.278597 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.278576 2563 scope.go:117] "RemoveContainer" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.285175 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.285159 2563 scope.go:117] "RemoveContainer" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.285428 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:04.285410 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": container with ID starting with 32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5 not found: ID does not exist" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.285472 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.285438 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} err="failed to get container status \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": rpc error: code = NotFound desc = could not find container \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": container with ID starting with 32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5 not found: ID does not exist" Sep 10 20:57:04.285472 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.285457 2563 scope.go:117] "RemoveContainer" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.285717 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:04.285698 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": container with ID starting with 5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931 not found: ID does not exist" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.285773 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.285724 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} err="failed to get container status \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": rpc error: code = NotFound desc = could not find container \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": container with ID starting with 5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931 not found: ID does not exist" Sep 10 20:57:04.285773 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.285739 2563 scope.go:117] "RemoveContainer" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.285949 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:04.285934 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": container with ID starting with 9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be not found: ID does not exist" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.285991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.285954 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} err="failed to get container status \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": rpc error: code = NotFound desc = could not find container \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": container with ID starting with 9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be not found: ID does not exist" Sep 10 20:57:04.285991 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.285967 2563 scope.go:117] "RemoveContainer" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.286158 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:04.286143 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": container with ID starting with 9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428 not found: ID does not exist" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.286196 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286162 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} err="failed to get container status \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": rpc error: code = NotFound desc = could not find container \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": container with ID starting with 9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428 not found: ID does not exist" Sep 10 20:57:04.286196 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286176 2563 scope.go:117] "RemoveContainer" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.286368 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:04.286355 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": container with ID starting with 7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6 not found: ID does not exist" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.286414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286371 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} err="failed to get container status \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": rpc error: code = NotFound desc = could not find container \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": container with ID starting with 7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6 not found: ID does not exist" Sep 10 20:57:04.286414 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286383 2563 scope.go:117] "RemoveContainer" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.286619 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:04.286605 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": container with ID starting with f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7 not found: ID does not exist" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.286663 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286624 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} err="failed to get container status \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": rpc error: code = NotFound desc = could not find container \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": container with ID starting with f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7 not found: ID does not exist" Sep 10 20:57:04.286663 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286637 2563 scope.go:117] "RemoveContainer" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.286847 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:04.286832 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": container with ID starting with d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5 not found: ID does not exist" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.286892 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286849 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5"} err="failed to get container status \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": rpc error: code = NotFound desc = could not find container \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": container with ID starting with d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5 not found: ID does not exist" Sep 10 20:57:04.286892 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.286861 2563 scope.go:117] "RemoveContainer" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.287047 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287032 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} err="failed to get container status \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": rpc error: code = NotFound desc = could not find container \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": container with ID starting with 32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5 not found: ID does not exist" Sep 10 20:57:04.287085 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287047 2563 scope.go:117] "RemoveContainer" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.287229 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287215 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} err="failed to get container status \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": rpc error: code = NotFound desc = could not find container \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": container with ID starting with 5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931 not found: ID does not exist" Sep 10 20:57:04.287271 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287229 2563 scope.go:117] "RemoveContainer" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.287409 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287394 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} err="failed to get container status \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": rpc error: code = NotFound desc = could not find container \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": container with ID starting with 9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be not found: ID does not exist" Sep 10 20:57:04.287456 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287409 2563 scope.go:117] "RemoveContainer" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.287599 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287584 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} err="failed to get container status \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": rpc error: code = NotFound desc = could not find container \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": container with ID starting with 9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428 not found: ID does not exist" Sep 10 20:57:04.287698 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287599 2563 scope.go:117] "RemoveContainer" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.287853 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287834 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} err="failed to get container status \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": rpc error: code = NotFound desc = could not find container \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": container with ID starting with 7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6 not found: ID does not exist" Sep 10 20:57:04.287853 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.287852 2563 scope.go:117] "RemoveContainer" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.288037 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288022 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} err="failed to get container status \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": rpc error: code = NotFound desc = could not find container \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": container with ID starting with f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7 not found: ID does not exist" Sep 10 20:57:04.288085 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288038 2563 scope.go:117] "RemoveContainer" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.288305 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288286 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5"} err="failed to get container status \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": rpc error: code = NotFound desc = could not find container \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": container with ID starting with d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5 not found: ID does not exist" Sep 10 20:57:04.288362 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288306 2563 scope.go:117] "RemoveContainer" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.288534 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288513 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} err="failed to get container status \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": rpc error: code = NotFound desc = could not find container \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": container with ID starting with 32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5 not found: ID does not exist" Sep 10 20:57:04.288608 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288533 2563 scope.go:117] "RemoveContainer" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.288828 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288809 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} err="failed to get container status \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": rpc error: code = NotFound desc = could not find container \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": container with ID starting with 5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931 not found: ID does not exist" Sep 10 20:57:04.288868 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.288828 2563 scope.go:117] "RemoveContainer" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.289056 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289038 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} err="failed to get container status \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": rpc error: code = NotFound desc = could not find container \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": container with ID starting with 9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be not found: ID does not exist" Sep 10 20:57:04.289107 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289057 2563 scope.go:117] "RemoveContainer" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.289281 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289266 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} err="failed to get container status \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": rpc error: code = NotFound desc = could not find container \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": container with ID starting with 9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428 not found: ID does not exist" Sep 10 20:57:04.289322 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289281 2563 scope.go:117] "RemoveContainer" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.289494 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289477 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} err="failed to get container status \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": rpc error: code = NotFound desc = could not find container \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": container with ID starting with 7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6 not found: ID does not exist" Sep 10 20:57:04.289494 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289493 2563 scope.go:117] "RemoveContainer" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.289712 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289693 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} err="failed to get container status \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": rpc error: code = NotFound desc = could not find container \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": container with ID starting with f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7 not found: ID does not exist" Sep 10 20:57:04.289752 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289712 2563 scope.go:117] "RemoveContainer" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.289933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289905 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5"} err="failed to get container status \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": rpc error: code = NotFound desc = could not find container \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": container with ID starting with d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5 not found: ID does not exist" Sep 10 20:57:04.289933 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.289932 2563 scope.go:117] "RemoveContainer" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.290125 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290110 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} err="failed to get container status \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": rpc error: code = NotFound desc = could not find container \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": container with ID starting with 32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5 not found: ID does not exist" Sep 10 20:57:04.290165 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290124 2563 scope.go:117] "RemoveContainer" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.290342 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290324 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} err="failed to get container status \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": rpc error: code = NotFound desc = could not find container \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": container with ID starting with 5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931 not found: ID does not exist" Sep 10 20:57:04.290385 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290343 2563 scope.go:117] "RemoveContainer" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.290551 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290535 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} err="failed to get container status \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": rpc error: code = NotFound desc = could not find container \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": container with ID starting with 9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be not found: ID does not exist" Sep 10 20:57:04.290551 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290549 2563 scope.go:117] "RemoveContainer" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.290780 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290763 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} err="failed to get container status \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": rpc error: code = NotFound desc = could not find container \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": container with ID starting with 9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428 not found: ID does not exist" Sep 10 20:57:04.290819 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290781 2563 scope.go:117] "RemoveContainer" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.291008 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.290984 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} err="failed to get container status \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": rpc error: code = NotFound desc = could not find container \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": container with ID starting with 7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6 not found: ID does not exist" Sep 10 20:57:04.291065 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291009 2563 scope.go:117] "RemoveContainer" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.291231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291200 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} err="failed to get container status \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": rpc error: code = NotFound desc = could not find container \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": container with ID starting with f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7 not found: ID does not exist" Sep 10 20:57:04.291231 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291230 2563 scope.go:117] "RemoveContainer" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.291467 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291449 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5"} err="failed to get container status \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": rpc error: code = NotFound desc = could not find container \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": container with ID starting with d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5 not found: ID does not exist" Sep 10 20:57:04.291512 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291469 2563 scope.go:117] "RemoveContainer" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.291730 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291712 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} err="failed to get container status \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": rpc error: code = NotFound desc = could not find container \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": container with ID starting with 32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5 not found: ID does not exist" Sep 10 20:57:04.291793 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291731 2563 scope.go:117] "RemoveContainer" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.291955 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291938 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} err="failed to get container status \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": rpc error: code = NotFound desc = could not find container \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": container with ID starting with 5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931 not found: ID does not exist" Sep 10 20:57:04.291995 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.291955 2563 scope.go:117] "RemoveContainer" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.292183 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292165 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} err="failed to get container status \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": rpc error: code = NotFound desc = could not find container \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": container with ID starting with 9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be not found: ID does not exist" Sep 10 20:57:04.292236 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292183 2563 scope.go:117] "RemoveContainer" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.292387 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292370 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} err="failed to get container status \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": rpc error: code = NotFound desc = could not find container \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": container with ID starting with 9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428 not found: ID does not exist" Sep 10 20:57:04.292426 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292390 2563 scope.go:117] "RemoveContainer" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.292672 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292656 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} err="failed to get container status \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": rpc error: code = NotFound desc = could not find container \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": container with ID starting with 7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6 not found: ID does not exist" Sep 10 20:57:04.292672 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292672 2563 scope.go:117] "RemoveContainer" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.292909 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292891 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} err="failed to get container status \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": rpc error: code = NotFound desc = could not find container \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": container with ID starting with f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7 not found: ID does not exist" Sep 10 20:57:04.292959 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.292909 2563 scope.go:117] "RemoveContainer" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.293103 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293087 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5"} err="failed to get container status \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": rpc error: code = NotFound desc = could not find container \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": container with ID starting with d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5 not found: ID does not exist" Sep 10 20:57:04.293140 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293103 2563 scope.go:117] "RemoveContainer" containerID="32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5" Sep 10 20:57:04.293317 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293301 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5"} err="failed to get container status \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": rpc error: code = NotFound desc = could not find container \"32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5\": container with ID starting with 32d31661cfe718f40a1a51c78469cd8cfb138ef94dc0369e7cf87074154693d5 not found: ID does not exist" Sep 10 20:57:04.293358 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293318 2563 scope.go:117] "RemoveContainer" containerID="5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931" Sep 10 20:57:04.293503 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293489 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931"} err="failed to get container status \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": rpc error: code = NotFound desc = could not find container \"5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931\": container with ID starting with 5e8196181d876a68bd7e74cdbbb2f49d0fcb8955057074fc95c20fb2bafbf931 not found: ID does not exist" Sep 10 20:57:04.293544 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293503 2563 scope.go:117] "RemoveContainer" containerID="9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be" Sep 10 20:57:04.293728 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293713 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be"} err="failed to get container status \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": rpc error: code = NotFound desc = could not find container \"9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be\": container with ID starting with 9eb1397a78b40a7aec526275d289ab8d4c1927531f3444dff992a8e84c5422be not found: ID does not exist" Sep 10 20:57:04.293728 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293727 2563 scope.go:117] "RemoveContainer" containerID="9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428" Sep 10 20:57:04.293931 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293909 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428"} err="failed to get container status \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": rpc error: code = NotFound desc = could not find container \"9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428\": container with ID starting with 9ea6a9103f6088e4e2987f5dea735f2b011e2a98ab7350dfd8d2515738eed428 not found: ID does not exist" Sep 10 20:57:04.293972 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.293931 2563 scope.go:117] "RemoveContainer" containerID="7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6" Sep 10 20:57:04.294143 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.294128 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6"} err="failed to get container status \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": rpc error: code = NotFound desc = could not find container \"7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6\": container with ID starting with 7b8f0e3ef45475a2bee5879bdf5dca949b29db54151bd168a7f467167b32c3e6 not found: ID does not exist" Sep 10 20:57:04.294189 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.294143 2563 scope.go:117] "RemoveContainer" containerID="f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7" Sep 10 20:57:04.294368 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.294349 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7"} err="failed to get container status \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": rpc error: code = NotFound desc = could not find container \"f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7\": container with ID starting with f7a3e721121b618db8db4b1f34b939664e8570195c2e0d5785b72972abca15b7 not found: ID does not exist" Sep 10 20:57:04.294368 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.294367 2563 scope.go:117] "RemoveContainer" containerID="d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5" Sep 10 20:57:04.294552 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.294537 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5"} err="failed to get container status \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": rpc error: code = NotFound desc = could not find container \"d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5\": container with ID starting with d49e2b660e288890077f2bd4c70d382dae1f998e4b498221025436ebf66c13b5 not found: ID does not exist" Sep 10 20:57:04.308054 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308036 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-out\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308120 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308058 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-main-tls\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308120 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308068 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-tls-assets\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308120 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308077 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308120 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308086 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308120 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308097 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdmht\" (UniqueName: \"kubernetes.io/projected/f5d440ea-13b5-46f8-88bd-c09d5c98e106-kube-api-access-vdmht\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308120 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308110 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308120 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308120 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-config-volume\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308318 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308130 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-main-db\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308318 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308158 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-web-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308318 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308166 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5d440ea-13b5-46f8-88bd-c09d5c98e106-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.308318 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.308175 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5d440ea-13b5-46f8-88bd-c09d5c98e106-cluster-tls-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:04.559993 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.559958 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:57:04.565938 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.565901 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:57:04.595570 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.595539 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:57:04.595993 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.595965 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91803df8-e347-4232-8760-9a1509e12c34" containerName="console" Sep 10 20:57:04.595993 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.595987 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="91803df8-e347-4232-8760-9a1509e12c34" containerName="console" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596002 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="alertmanager" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596010 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="alertmanager" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596023 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="config-reloader" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596031 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="config-reloader" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596045 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-web" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596054 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-web" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596064 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596072 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596087 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="prom-label-proxy" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596094 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="prom-label-proxy" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596104 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b76eb2-e275-4931-b6e4-903892724d0d" containerName="console" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596111 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b76eb2-e275-4931-b6e4-903892724d0d" containerName="console" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596122 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74916aa6-9a3d-4206-9130-f357c754c345" containerName="console" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596131 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74916aa6-9a3d-4206-9130-f357c754c345" containerName="console" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596149 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="init-config-reloader" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596159 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="init-config-reloader" Sep 10 20:57:04.596170 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596170 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-metric" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596178 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-metric" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596264 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b76eb2-e275-4931-b6e4-903892724d0d" containerName="console" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596274 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="91803df8-e347-4232-8760-9a1509e12c34" containerName="console" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596282 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596292 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="alertmanager" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596303 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="prom-label-proxy" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596312 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="config-reloader" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596322 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-web" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596331 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" containerName="kube-rbac-proxy-metric" Sep 10 20:57:04.597027 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.596342 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74916aa6-9a3d-4206-9130-f357c754c345" containerName="console" Sep 10 20:57:04.600387 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.600367 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.602465 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.602444 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 20:57:04.602615 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.602600 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 20:57:04.602706 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.602662 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 20:57:04.602776 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.602693 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-95wsr\"" Sep 10 20:57:04.602993 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.602977 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 20:57:04.603073 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.602994 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 20:57:04.603073 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.603034 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 20:57:04.603177 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.603087 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 20:57:04.603177 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.603091 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 20:57:04.607746 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.607603 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 20:57:04.610015 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.609992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37c3c5b-a99d-4548-8319-814c23b71a7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610107 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-web-config\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610107 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37c3c5b-a99d-4548-8319-814c23b71a7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610107 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610232 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37c3c5b-a99d-4548-8319-814c23b71a7b-config-out\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610232 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610232 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610232 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pddp9\" (UniqueName: \"kubernetes.io/projected/e37c3c5b-a99d-4548-8319-814c23b71a7b-kube-api-access-pddp9\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610369 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610369 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37c3c5b-a99d-4548-8319-814c23b71a7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610369 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610500 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e37c3c5b-a99d-4548-8319-814c23b71a7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.610500 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.610387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.612885 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.612844 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:57:04.710930 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.710893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.710930 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.710927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37c3c5b-a99d-4548-8319-814c23b71a7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711181 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.710946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711181 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.710969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e37c3c5b-a99d-4548-8319-814c23b71a7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711181 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711181 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37c3c5b-a99d-4548-8319-814c23b71a7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711373 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-web-config\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711373 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37c3c5b-a99d-4548-8319-814c23b71a7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711373 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711373 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711329 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e37c3c5b-a99d-4548-8319-814c23b71a7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711373 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37c3c5b-a99d-4548-8319-814c23b71a7b-config-out\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711638 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711638 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711638 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pddp9\" (UniqueName: \"kubernetes.io/projected/e37c3c5b-a99d-4548-8319-814c23b71a7b-kube-api-access-pddp9\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.711974 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.711948 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37c3c5b-a99d-4548-8319-814c23b71a7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.712195 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.712171 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e37c3c5b-a99d-4548-8319-814c23b71a7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714159 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714184 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e37c3c5b-a99d-4548-8319-814c23b71a7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714288 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-web-config\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714323 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714647 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e37c3c5b-a99d-4548-8319-814c23b71a7b-config-out\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.714957 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.714938 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.716125 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.716103 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e37c3c5b-a99d-4548-8319-814c23b71a7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.721159 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.721142 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pddp9\" (UniqueName: \"kubernetes.io/projected/e37c3c5b-a99d-4548-8319-814c23b71a7b-kube-api-access-pddp9\") pod \"alertmanager-main-0\" (UID: \"e37c3c5b-a99d-4548-8319-814c23b71a7b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:04.910082 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:04.909996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 20:57:05.189331 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:05.189306 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 20:57:05.191166 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:57:05.191141 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37c3c5b_a99d_4548_8319_814c23b71a7b.slice/crio-bc048002d80c4fe9ce6c353bec5757042914cf549fc0ddfdfce20cceb2fa031e WatchSource:0}: Error finding container bc048002d80c4fe9ce6c353bec5757042914cf549fc0ddfdfce20cceb2fa031e: Status 404 returned error can't find the container with id bc048002d80c4fe9ce6c353bec5757042914cf549fc0ddfdfce20cceb2fa031e Sep 10 20:57:05.241463 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:05.241428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerStarted","Data":"bc048002d80c4fe9ce6c353bec5757042914cf549fc0ddfdfce20cceb2fa031e"} Sep 10 20:57:05.325917 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:05.325884 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5d440ea-13b5-46f8-88bd-c09d5c98e106" path="/var/lib/kubelet/pods/f5d440ea-13b5-46f8-88bd-c09d5c98e106/volumes" Sep 10 20:57:06.247237 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:06.247207 2563 generic.go:356] "Generic (PLEG): container finished" podID="e37c3c5b-a99d-4548-8319-814c23b71a7b" containerID="805eef69518af6eff75adbb1c787c06c645da2de8317db6f590ad3974cefd6e4" exitCode=0 Sep 10 20:57:06.247621 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:06.247267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerDied","Data":"805eef69518af6eff75adbb1c787c06c645da2de8317db6f590ad3974cefd6e4"} Sep 10 20:57:07.255037 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:07.255002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerStarted","Data":"e1d34ba56e08e3eb1db8b3b222144210243d91460f0eb2bcd5fb492dccadcba4"} Sep 10 20:57:07.255412 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:07.255093 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerStarted","Data":"8a8b69180c6a34d4235e7545e4b531d7ea386cc857cbed3c716a9bfa8ef7af35"} Sep 10 20:57:07.255412 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:07.255122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerStarted","Data":"fdfb25a088224921683af88f9a18b4ee26a66ff14bbff8559d14ca317f251e47"} Sep 10 20:57:07.255412 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:07.255145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerStarted","Data":"2796214bae7505f725b1346db66bad36e749031004f220ab84223ee5986926cc"} Sep 10 20:57:07.255412 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:07.255169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerStarted","Data":"23b387644b6a68a2b832e6bf0d8c185aba06bb2e9b240e7e3a70d7396201db6a"} Sep 10 20:57:07.255412 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:07.255191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e37c3c5b-a99d-4548-8319-814c23b71a7b","Type":"ContainerStarted","Data":"bbc2a012dc130f658686df1b7e109113113cd9cef26023f6d6d19d5d9a1a36de"} Sep 10 20:57:07.281877 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:07.281611 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.267081291 podStartE2EDuration="3.281589267s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.507976ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:07.279857082 +0000 UTC m=+146.494412408" watchObservedRunningTime="2026-09-10 20:57:07.281589267 +0000 UTC m=+146.496144555" Sep 10 20:57:08.198697 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.198656 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:57:08.199133 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.199078 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="prometheus" containerID="cri-o://224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" gracePeriod=600 Sep 10 20:57:08.199633 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.199602 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy" containerID="cri-o://4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" gracePeriod=600 Sep 10 20:57:08.200184 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.199801 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-thanos" containerID="cri-o://15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" gracePeriod=600 Sep 10 20:57:08.200184 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.199940 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="config-reloader" containerID="cri-o://9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" gracePeriod=600 Sep 10 20:57:08.200184 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.199718 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-web" containerID="cri-o://49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" gracePeriod=600 Sep 10 20:57:08.200184 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.200034 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="thanos-sidecar" containerID="cri-o://9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" gracePeriod=600 Sep 10 20:57:08.293376 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.293345 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f56df9fd-8mlzg"] Sep 10 20:57:08.295955 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.295920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.309736 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.309354 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f56df9fd-8mlzg"] Sep 10 20:57:08.342649 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.342615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-config\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.342649 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.342647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-service-ca\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.342894 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.342860 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-oauth-serving-cert\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.343102 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.343049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-serving-cert\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.343182 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.343121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-trusted-ca-bundle\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.343182 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.343173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb2m8\" (UniqueName: \"kubernetes.io/projected/cfe952a2-beba-4149-89ff-a935e2fc1aed-kube-api-access-kb2m8\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.343279 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.343210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-oauth-config\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445240 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.444436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-oauth-serving-cert\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445240 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.444509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-serving-cert\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445240 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.444534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-trusted-ca-bundle\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445240 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.444581 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb2m8\" (UniqueName: \"kubernetes.io/projected/cfe952a2-beba-4149-89ff-a935e2fc1aed-kube-api-access-kb2m8\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445240 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.444609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-oauth-config\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445240 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.444653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-config\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445240 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.444676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-service-ca\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445720 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.445473 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-service-ca\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.445946 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.445907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-config\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.446269 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.446221 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-oauth-serving-cert\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.446465 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.446442 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-trusted-ca-bundle\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.448005 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.447981 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-oauth-config\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.448207 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.448190 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-serving-cert\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.452191 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.451894 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:08.454020 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.453993 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb2m8\" (UniqueName: \"kubernetes.io/projected/cfe952a2-beba-4149-89ff-a935e2fc1aed-kube-api-access-kb2m8\") pod \"console-57f56df9fd-8mlzg\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.546041 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546010 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-tls-assets\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546071 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-kube-rbac-proxy\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546094 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546146 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-web-config\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546180 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-metrics-client-ca\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546204 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-thanos-prometheus-http-client-file\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546480 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546242 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-grpc-tls\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546480 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546273 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-trusted-ca-bundle\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546480 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546300 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-serving-certs-ca-bundle\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546480 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546329 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-1\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546480 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546355 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-kubelet-serving-ca-bundle\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546480 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546394 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-db\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546480 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546446 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546885 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546485 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546885 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546510 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-tls\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546885 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546587 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-metrics-client-certs\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546885 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546593 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:08.546885 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546619 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-0\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.546885 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546645 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnv69\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-kube-api-access-tnv69\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.547199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546932 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:08.547199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.546981 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-2\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.547199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.547020 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config-out\") pod \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\" (UID: \"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe\") " Sep 10 20:57:08.547353 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.547337 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-metrics-client-ca\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.547404 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.547359 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.548675 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.548416 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:08.549099 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.548989 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config" (OuterVolumeSpecName: "config") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.549099 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.549068 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.549272 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.549197 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:57:08.549362 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.549338 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-kube-api-access-tnv69" (OuterVolumeSpecName: "kube-api-access-tnv69") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "kube-api-access-tnv69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:57:08.550091 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.549973 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:08.550466 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.550334 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config-out" (OuterVolumeSpecName: "config-out") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 20:57:08.550466 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.550381 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:08.550882 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.550672 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.550882 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.550699 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:08.550882 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.550766 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 20:57:08.551073 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.550947 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.551371 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.551336 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.551525 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.551499 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.551877 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.551857 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:08.552753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.552729 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.552865 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.552849 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.560583 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.560547 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-web-config" (OuterVolumeSpecName: "web-config") pod "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" (UID: "a11b87b6-e6be-48df-8284-e8e3cb1d5dbe"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:08.624949 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.624903 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:08.648135 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648108 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648136 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnv69\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-kube-api-access-tnv69\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648154 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648168 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config-out\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648180 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-tls-assets\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648192 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-kube-rbac-proxy\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648203 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648217 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-web-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648230 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648241 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-grpc-tls\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648253 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648267 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648283 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648298 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-prometheus-k8s-db\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648312 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648326 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648341 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.648637 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.648353 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe-secret-metrics-client-certs\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:08.898458 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:08.898429 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f56df9fd-8mlzg"] Sep 10 20:57:08.900508 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:57:08.900479 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe952a2_beba_4149_89ff_a935e2fc1aed.slice/crio-3cb9bc014638bca6a39aa4c012d00faf9a6671f1576ccb09e6976475e03d2095 WatchSource:0}: Error finding container 3cb9bc014638bca6a39aa4c012d00faf9a6671f1576ccb09e6976475e03d2095: Status 404 returned error can't find the container with id 3cb9bc014638bca6a39aa4c012d00faf9a6671f1576ccb09e6976475e03d2095 Sep 10 20:57:09.268626 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268583 2563 generic.go:356] "Generic (PLEG): container finished" podID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" exitCode=0 Sep 10 20:57:09.268626 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268615 2563 generic.go:356] "Generic (PLEG): container finished" podID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" exitCode=0 Sep 10 20:57:09.268626 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268624 2563 generic.go:356] "Generic (PLEG): container finished" podID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" exitCode=0 Sep 10 20:57:09.268626 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268631 2563 generic.go:356] "Generic (PLEG): container finished" podID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" exitCode=0 Sep 10 20:57:09.268626 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268637 2563 generic.go:356] "Generic (PLEG): container finished" podID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" exitCode=0 Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268642 2563 generic.go:356] "Generic (PLEG): container finished" podID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" exitCode=0 Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268687 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268780 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268822 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268855 2563 scope.go:117] "RemoveContainer" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} Sep 10 20:57:09.268924 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268907 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} Sep 10 20:57:09.269279 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} Sep 10 20:57:09.269279 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.268990 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a11b87b6-e6be-48df-8284-e8e3cb1d5dbe","Type":"ContainerDied","Data":"4f4da7fa1df10dc4b8d931ba8fe0a871578d04602c88e1729da7249c36c23624"} Sep 10 20:57:09.270680 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.270655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f56df9fd-8mlzg" event={"ID":"cfe952a2-beba-4149-89ff-a935e2fc1aed","Type":"ContainerStarted","Data":"28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139"} Sep 10 20:57:09.270776 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.270698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f56df9fd-8mlzg" event={"ID":"cfe952a2-beba-4149-89ff-a935e2fc1aed","Type":"ContainerStarted","Data":"3cb9bc014638bca6a39aa4c012d00faf9a6671f1576ccb09e6976475e03d2095"} Sep 10 20:57:09.276538 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.276516 2563 scope.go:117] "RemoveContainer" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.283931 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.283912 2563 scope.go:117] "RemoveContainer" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.290709 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.290688 2563 scope.go:117] "RemoveContainer" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.293392 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.293351 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57f56df9fd-8mlzg" podStartSLOduration=1.293337905 podStartE2EDuration="1.293337905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:09.291365899 +0000 UTC m=+148.505921186" watchObservedRunningTime="2026-09-10 20:57:09.293337905 +0000 UTC m=+148.507893193" Sep 10 20:57:09.298079 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.298056 2563 scope.go:117] "RemoveContainer" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.304919 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.304896 2563 scope.go:117] "RemoveContainer" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.306313 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.306290 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:57:09.311243 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.311219 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:57:09.314452 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.314432 2563 scope.go:117] "RemoveContainer" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.322043 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.322026 2563 scope.go:117] "RemoveContainer" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.322337 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:09.322312 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": container with ID starting with 15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf not found: ID does not exist" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.322411 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.322347 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} err="failed to get container status \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": rpc error: code = NotFound desc = could not find container \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": container with ID starting with 15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf not found: ID does not exist" Sep 10 20:57:09.322411 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.322367 2563 scope.go:117] "RemoveContainer" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.322609 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:09.322590 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": container with ID starting with 4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92 not found: ID does not exist" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.322679 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.322616 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} err="failed to get container status \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": rpc error: code = NotFound desc = could not find container \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": container with ID starting with 4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92 not found: ID does not exist" Sep 10 20:57:09.322679 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.322633 2563 scope.go:117] "RemoveContainer" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.322868 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:09.322854 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": container with ID starting with 49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48 not found: ID does not exist" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.322913 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.322871 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} err="failed to get container status \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": rpc error: code = NotFound desc = could not find container \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": container with ID starting with 49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48 not found: ID does not exist" Sep 10 20:57:09.322913 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.322885 2563 scope.go:117] "RemoveContainer" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.323093 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:09.323078 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": container with ID starting with 9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77 not found: ID does not exist" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.323133 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.323095 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} err="failed to get container status \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": rpc error: code = NotFound desc = could not find container \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": container with ID starting with 9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77 not found: ID does not exist" Sep 10 20:57:09.323133 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.323107 2563 scope.go:117] "RemoveContainer" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.323358 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:09.323336 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": container with ID starting with 9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31 not found: ID does not exist" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.323411 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.323368 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} err="failed to get container status \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": rpc error: code = NotFound desc = could not find container \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": container with ID starting with 9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31 not found: ID does not exist" Sep 10 20:57:09.323411 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.323387 2563 scope.go:117] "RemoveContainer" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.323723 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:09.323704 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": container with ID starting with 224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6 not found: ID does not exist" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.323779 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.323729 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} err="failed to get container status \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": rpc error: code = NotFound desc = could not find container \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": container with ID starting with 224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6 not found: ID does not exist" Sep 10 20:57:09.323779 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.323747 2563 scope.go:117] "RemoveContainer" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.324006 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:09.323990 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": container with ID starting with 2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f not found: ID does not exist" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.324065 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324010 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f"} err="failed to get container status \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": rpc error: code = NotFound desc = could not find container \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": container with ID starting with 2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f not found: ID does not exist" Sep 10 20:57:09.324065 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324024 2563 scope.go:117] "RemoveContainer" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.324270 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324256 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} err="failed to get container status \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": rpc error: code = NotFound desc = could not find container \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": container with ID starting with 15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf not found: ID does not exist" Sep 10 20:57:09.324313 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324270 2563 scope.go:117] "RemoveContainer" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.324467 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324451 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} err="failed to get container status \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": rpc error: code = NotFound desc = could not find container \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": container with ID starting with 4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92 not found: ID does not exist" Sep 10 20:57:09.324508 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324467 2563 scope.go:117] "RemoveContainer" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.324667 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324652 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} err="failed to get container status \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": rpc error: code = NotFound desc = could not find container \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": container with ID starting with 49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48 not found: ID does not exist" Sep 10 20:57:09.324724 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324666 2563 scope.go:117] "RemoveContainer" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.324943 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324917 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} err="failed to get container status \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": rpc error: code = NotFound desc = could not find container \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": container with ID starting with 9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77 not found: ID does not exist" Sep 10 20:57:09.325014 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.324947 2563 scope.go:117] "RemoveContainer" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.325271 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.325253 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} err="failed to get container status \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": rpc error: code = NotFound desc = could not find container \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": container with ID starting with 9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31 not found: ID does not exist" Sep 10 20:57:09.325271 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.325271 2563 scope.go:117] "RemoveContainer" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.325549 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.325528 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} err="failed to get container status \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": rpc error: code = NotFound desc = could not find container \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": container with ID starting with 224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6 not found: ID does not exist" Sep 10 20:57:09.325549 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.325549 2563 scope.go:117] "RemoveContainer" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.325858 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.325830 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f"} err="failed to get container status \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": rpc error: code = NotFound desc = could not find container \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": container with ID starting with 2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f not found: ID does not exist" Sep 10 20:57:09.325858 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.325857 2563 scope.go:117] "RemoveContainer" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.326158 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326137 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} err="failed to get container status \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": rpc error: code = NotFound desc = could not find container \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": container with ID starting with 15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf not found: ID does not exist" Sep 10 20:57:09.326215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326159 2563 scope.go:117] "RemoveContainer" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.326415 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326398 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} err="failed to get container status \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": rpc error: code = NotFound desc = could not find container \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": container with ID starting with 4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92 not found: ID does not exist" Sep 10 20:57:09.326415 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326414 2563 scope.go:117] "RemoveContainer" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.326652 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326636 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} err="failed to get container status \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": rpc error: code = NotFound desc = could not find container \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": container with ID starting with 49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48 not found: ID does not exist" Sep 10 20:57:09.326704 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326651 2563 scope.go:117] "RemoveContainer" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.326881 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326857 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} err="failed to get container status \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": rpc error: code = NotFound desc = could not find container \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": container with ID starting with 9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77 not found: ID does not exist" Sep 10 20:57:09.326881 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.326880 2563 scope.go:117] "RemoveContainer" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.327084 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327064 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" path="/var/lib/kubelet/pods/a11b87b6-e6be-48df-8284-e8e3cb1d5dbe/volumes" Sep 10 20:57:09.327189 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327167 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} err="failed to get container status \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": rpc error: code = NotFound desc = could not find container \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": container with ID starting with 9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31 not found: ID does not exist" Sep 10 20:57:09.327228 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327192 2563 scope.go:117] "RemoveContainer" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.327455 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327438 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} err="failed to get container status \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": rpc error: code = NotFound desc = could not find container \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": container with ID starting with 224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6 not found: ID does not exist" Sep 10 20:57:09.327455 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327455 2563 scope.go:117] "RemoveContainer" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.327708 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327678 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f"} err="failed to get container status \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": rpc error: code = NotFound desc = could not find container \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": container with ID starting with 2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f not found: ID does not exist" Sep 10 20:57:09.327708 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327701 2563 scope.go:117] "RemoveContainer" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.327938 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327918 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} err="failed to get container status \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": rpc error: code = NotFound desc = could not find container \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": container with ID starting with 15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf not found: ID does not exist" Sep 10 20:57:09.328008 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.327940 2563 scope.go:117] "RemoveContainer" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.328158 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328141 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} err="failed to get container status \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": rpc error: code = NotFound desc = could not find container \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": container with ID starting with 4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92 not found: ID does not exist" Sep 10 20:57:09.328284 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328159 2563 scope.go:117] "RemoveContainer" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.328396 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328377 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} err="failed to get container status \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": rpc error: code = NotFound desc = could not find container \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": container with ID starting with 49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48 not found: ID does not exist" Sep 10 20:57:09.328501 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328398 2563 scope.go:117] "RemoveContainer" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.328665 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328647 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} err="failed to get container status \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": rpc error: code = NotFound desc = could not find container \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": container with ID starting with 9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77 not found: ID does not exist" Sep 10 20:57:09.328736 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328667 2563 scope.go:117] "RemoveContainer" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.328940 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328913 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} err="failed to get container status \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": rpc error: code = NotFound desc = could not find container \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": container with ID starting with 9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31 not found: ID does not exist" Sep 10 20:57:09.328940 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.328940 2563 scope.go:117] "RemoveContainer" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.329248 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.329225 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} err="failed to get container status \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": rpc error: code = NotFound desc = could not find container \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": container with ID starting with 224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6 not found: ID does not exist" Sep 10 20:57:09.329329 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.329249 2563 scope.go:117] "RemoveContainer" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.329832 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.329614 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f"} err="failed to get container status \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": rpc error: code = NotFound desc = could not find container \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": container with ID starting with 2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f not found: ID does not exist" Sep 10 20:57:09.329832 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.329638 2563 scope.go:117] "RemoveContainer" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.330075 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.330055 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} err="failed to get container status \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": rpc error: code = NotFound desc = could not find container \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": container with ID starting with 15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf not found: ID does not exist" Sep 10 20:57:09.330161 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.330150 2563 scope.go:117] "RemoveContainer" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.330462 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.330443 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} err="failed to get container status \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": rpc error: code = NotFound desc = could not find container \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": container with ID starting with 4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92 not found: ID does not exist" Sep 10 20:57:09.330557 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.330547 2563 scope.go:117] "RemoveContainer" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.330891 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.330873 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} err="failed to get container status \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": rpc error: code = NotFound desc = could not find container \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": container with ID starting with 49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48 not found: ID does not exist" Sep 10 20:57:09.330986 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.330976 2563 scope.go:117] "RemoveContainer" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.331272 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.331253 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} err="failed to get container status \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": rpc error: code = NotFound desc = could not find container \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": container with ID starting with 9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77 not found: ID does not exist" Sep 10 20:57:09.331363 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.331354 2563 scope.go:117] "RemoveContainer" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.331668 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.331649 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} err="failed to get container status \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": rpc error: code = NotFound desc = could not find container \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": container with ID starting with 9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31 not found: ID does not exist" Sep 10 20:57:09.331761 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.331751 2563 scope.go:117] "RemoveContainer" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.332092 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.332070 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} err="failed to get container status \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": rpc error: code = NotFound desc = could not find container \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": container with ID starting with 224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6 not found: ID does not exist" Sep 10 20:57:09.332198 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.332188 2563 scope.go:117] "RemoveContainer" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.333214 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.332737 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f"} err="failed to get container status \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": rpc error: code = NotFound desc = could not find container \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": container with ID starting with 2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f not found: ID does not exist" Sep 10 20:57:09.333214 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.333188 2563 scope.go:117] "RemoveContainer" containerID="15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf" Sep 10 20:57:09.333498 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.333475 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf"} err="failed to get container status \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": rpc error: code = NotFound desc = could not find container \"15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf\": container with ID starting with 15212b23e7ead272d72c35e314f98af05f738f0101955637a56e6aa36f79bcbf not found: ID does not exist" Sep 10 20:57:09.333597 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.333500 2563 scope.go:117] "RemoveContainer" containerID="4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92" Sep 10 20:57:09.333826 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.333799 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92"} err="failed to get container status \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": rpc error: code = NotFound desc = could not find container \"4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92\": container with ID starting with 4b0d9304a6e70d3300f29d81fbf60398641da323ba9f3af2db1a79e4b7e72e92 not found: ID does not exist" Sep 10 20:57:09.333826 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.333824 2563 scope.go:117] "RemoveContainer" containerID="49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48" Sep 10 20:57:09.334150 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334130 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48"} err="failed to get container status \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": rpc error: code = NotFound desc = could not find container \"49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48\": container with ID starting with 49b0a958055d7fdfb14d37f4aebc054c187979232e9d6a987a0db4221a65fb48 not found: ID does not exist" Sep 10 20:57:09.334226 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334151 2563 scope.go:117] "RemoveContainer" containerID="9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77" Sep 10 20:57:09.334399 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334370 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77"} err="failed to get container status \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": rpc error: code = NotFound desc = could not find container \"9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77\": container with ID starting with 9d4f807da877db8c4b0d07a4fbbec4a33404e58a88a8ea3a04cbe63a48e57a77 not found: ID does not exist" Sep 10 20:57:09.334445 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334401 2563 scope.go:117] "RemoveContainer" containerID="9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31" Sep 10 20:57:09.334673 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334655 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31"} err="failed to get container status \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": rpc error: code = NotFound desc = could not find container \"9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31\": container with ID starting with 9b984cad23018816467a0cf3b977629efe34850c9637a743d55e33acbeb9db31 not found: ID does not exist" Sep 10 20:57:09.334728 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334674 2563 scope.go:117] "RemoveContainer" containerID="224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6" Sep 10 20:57:09.334953 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334934 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6"} err="failed to get container status \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": rpc error: code = NotFound desc = could not find container \"224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6\": container with ID starting with 224db958b0c997cff21f5ebb1083ed0feb9f93012def223047cf3aa6b07517f6 not found: ID does not exist" Sep 10 20:57:09.335036 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.334955 2563 scope.go:117] "RemoveContainer" containerID="2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f" Sep 10 20:57:09.335215 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335195 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f"} err="failed to get container status \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": rpc error: code = NotFound desc = could not find container \"2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f\": container with ID starting with 2ede243502dce936a4bcfeb771b721cf2dfdc9424898a66888956263304f361f not found: ID does not exist" Sep 10 20:57:09.335367 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335352 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:57:09.335677 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335665 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy" Sep 10 20:57:09.335710 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335680 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy" Sep 10 20:57:09.335710 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335695 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="init-config-reloader" Sep 10 20:57:09.335710 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335701 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="init-config-reloader" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335711 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-web" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335717 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-web" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335726 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="thanos-sidecar" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335731 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="thanos-sidecar" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335737 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-thanos" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335741 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-thanos" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335748 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="prometheus" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335753 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="prometheus" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335760 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="config-reloader" Sep 10 20:57:09.335797 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335765 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="config-reloader" Sep 10 20:57:09.336061 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335819 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy" Sep 10 20:57:09.336061 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335828 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-web" Sep 10 20:57:09.336061 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335835 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="prometheus" Sep 10 20:57:09.336061 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335840 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="config-reloader" Sep 10 20:57:09.336061 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335847 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="thanos-sidecar" Sep 10 20:57:09.336061 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.335852 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11b87b6-e6be-48df-8284-e8e3cb1d5dbe" containerName="kube-rbac-proxy-thanos" Sep 10 20:57:09.338860 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.338845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.341184 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341161 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 20:57:09.341265 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341173 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 20:57:09.341265 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341239 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 20:57:09.341374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341187 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 20:57:09.341374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341276 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5wjbr\"" Sep 10 20:57:09.341374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341305 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 20:57:09.341374 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341349 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 20:57:09.341738 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341720 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 20:57:09.341823 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341808 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 20:57:09.341878 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 20:57:09.341878 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341824 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 20:57:09.341989 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.341930 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 20:57:09.342368 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.342352 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dgm2kkj8tn0ki\"" Sep 10 20:57:09.342463 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.342433 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 20:57:09.344698 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.344676 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 20:57:09.347047 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.347026 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 20:57:09.353326 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353408 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353461 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353500 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353592 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353688 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwcxv\" (UniqueName: \"kubernetes.io/projected/da333602-54cb-4f88-80d8-7ea1f294b214-kube-api-access-kwcxv\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353787 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353856 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353856 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.353960 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354031 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354013 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:57:09.354095 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.353995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-web-config\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354149 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da333602-54cb-4f88-80d8-7ea1f294b214-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354193 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354193 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354309 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-config\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354309 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354309 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354309 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da333602-54cb-4f88-80d8-7ea1f294b214-config-out\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.354422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.354347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.455628 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.455595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.455798 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.455636 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwcxv\" (UniqueName: \"kubernetes.io/projected/da333602-54cb-4f88-80d8-7ea1f294b214-kube-api-access-kwcxv\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.455798 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.455670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.455798 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.455690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.455798 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.455720 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456071 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456124 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-web-config\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456124 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456113 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da333602-54cb-4f88-80d8-7ea1f294b214-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456221 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456221 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456221 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-config\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456372 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456372 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456372 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456372 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456308 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456372 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da333602-54cb-4f88-80d8-7ea1f294b214-config-out\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456372 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456689 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456689 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456392 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456689 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456689 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456689 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.456936 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.456802 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.457091 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.457068 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.457763 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.457737 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.459422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.459111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.459422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.459138 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da333602-54cb-4f88-80d8-7ea1f294b214-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.459422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.459212 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.459422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.459334 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.459422 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.459418 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-config\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.459870 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.459845 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.460119 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.460088 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.460367 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.460343 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.460439 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.460422 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.460688 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.460670 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.461808 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.461781 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.461906 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.461781 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da333602-54cb-4f88-80d8-7ea1f294b214-web-config\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.461906 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.461885 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da333602-54cb-4f88-80d8-7ea1f294b214-config-out\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.462853 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.462838 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwcxv\" (UniqueName: \"kubernetes.io/projected/da333602-54cb-4f88-80d8-7ea1f294b214-kube-api-access-kwcxv\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.463869 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.463841 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da333602-54cb-4f88-80d8-7ea1f294b214-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da333602-54cb-4f88-80d8-7ea1f294b214\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.649288 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.649261 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:09.929427 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:09.929342 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 20:57:09.932639 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:57:09.932609 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda333602_54cb_4f88_80d8_7ea1f294b214.slice/crio-58d50e5e75ba368e8faf8c75013f564a5f4b1232225a32d98f7ce489bc17a7d8 WatchSource:0}: Error finding container 58d50e5e75ba368e8faf8c75013f564a5f4b1232225a32d98f7ce489bc17a7d8: Status 404 returned error can't find the container with id 58d50e5e75ba368e8faf8c75013f564a5f4b1232225a32d98f7ce489bc17a7d8 Sep 10 20:57:10.282487 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:10.282452 2563 generic.go:356] "Generic (PLEG): container finished" podID="da333602-54cb-4f88-80d8-7ea1f294b214" containerID="b2d69e2ab506c56342ccc66f6c4ca93e8a2dc6ccc77e49dd5fdb3d6faf4819da" exitCode=0 Sep 10 20:57:10.282655 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:10.282531 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerDied","Data":"b2d69e2ab506c56342ccc66f6c4ca93e8a2dc6ccc77e49dd5fdb3d6faf4819da"} Sep 10 20:57:10.282655 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:10.282640 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerStarted","Data":"58d50e5e75ba368e8faf8c75013f564a5f4b1232225a32d98f7ce489bc17a7d8"} Sep 10 20:57:11.290309 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:11.290274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerStarted","Data":"dff958dc24692efb31d187e2413a685690832e8d79b739500239a6b4eb03fa8c"} Sep 10 20:57:11.290753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:11.290339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerStarted","Data":"64c24662c7b5c5ca5fedafcad64a9e0675fbe61d4494232a94371cbec2907722"} Sep 10 20:57:11.290753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:11.290368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerStarted","Data":"20b1b2a4ac36d03dc8d8fad97a381691af26f89237375d55cafaa6e39be6b429"} Sep 10 20:57:11.290753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:11.290393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerStarted","Data":"83823fffa31e15a5e49d6ab4cc80fa6d1585c9bfdc57338fa7b2e31e145f619d"} Sep 10 20:57:11.290753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:11.290416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerStarted","Data":"e90c23a566bdd6a4e96031c4409dc37dce03b36374468a09e9af8084484a607e"} Sep 10 20:57:11.290753 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:11.290437 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da333602-54cb-4f88-80d8-7ea1f294b214","Type":"ContainerStarted","Data":"cb643e14ba5d01905200deb0f6590d83ba0d5d369dc0c6860115d31657e43e7c"} Sep 10 20:57:11.317266 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:11.317196 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.295004822 podStartE2EDuration="2.317175652s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.17083ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:11.316058117 +0000 UTC m=+150.530613407" watchObservedRunningTime="2026-09-10 20:57:11.317175652 +0000 UTC m=+150.531730932" Sep 10 20:57:14.650441 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:14.650404 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:57:18.625461 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:18.625403 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:18.625843 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:18.625494 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:18.629921 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:18.629891 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:19.329533 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:19.329504 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 20:57:19.380366 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:19.380336 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588596f558-pfzd2"] Sep 10 20:57:44.400639 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.400558 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-588596f558-pfzd2" podUID="842066df-e494-45bd-a3af-4531689a0c03" containerName="console" containerID="cri-o://b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9" gracePeriod=15 Sep 10 20:57:44.638437 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.638414 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:57:44.680976 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.680893 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-serving-cert\") pod \"842066df-e494-45bd-a3af-4531689a0c03\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " Sep 10 20:57:44.680976 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.680933 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-service-ca\") pod \"842066df-e494-45bd-a3af-4531689a0c03\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " Sep 10 20:57:44.680976 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.680964 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-oauth-config\") pod \"842066df-e494-45bd-a3af-4531689a0c03\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " Sep 10 20:57:44.681226 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.680986 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzmvd\" (UniqueName: \"kubernetes.io/projected/842066df-e494-45bd-a3af-4531689a0c03-kube-api-access-qzmvd\") pod \"842066df-e494-45bd-a3af-4531689a0c03\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " Sep 10 20:57:44.681226 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.681050 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-trusted-ca-bundle\") pod \"842066df-e494-45bd-a3af-4531689a0c03\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " Sep 10 20:57:44.681226 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.681120 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-console-config\") pod \"842066df-e494-45bd-a3af-4531689a0c03\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " Sep 10 20:57:44.681226 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.681167 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-oauth-serving-cert\") pod \"842066df-e494-45bd-a3af-4531689a0c03\" (UID: \"842066df-e494-45bd-a3af-4531689a0c03\") " Sep 10 20:57:44.681463 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.681437 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-service-ca" (OuterVolumeSpecName: "service-ca") pod "842066df-e494-45bd-a3af-4531689a0c03" (UID: "842066df-e494-45bd-a3af-4531689a0c03"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:44.681535 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.681509 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "842066df-e494-45bd-a3af-4531689a0c03" (UID: "842066df-e494-45bd-a3af-4531689a0c03"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:44.681618 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.681527 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-console-config" (OuterVolumeSpecName: "console-config") pod "842066df-e494-45bd-a3af-4531689a0c03" (UID: "842066df-e494-45bd-a3af-4531689a0c03"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:44.681787 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.681762 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "842066df-e494-45bd-a3af-4531689a0c03" (UID: "842066df-e494-45bd-a3af-4531689a0c03"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 20:57:44.683150 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.683117 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "842066df-e494-45bd-a3af-4531689a0c03" (UID: "842066df-e494-45bd-a3af-4531689a0c03"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:44.683250 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.683151 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "842066df-e494-45bd-a3af-4531689a0c03" (UID: "842066df-e494-45bd-a3af-4531689a0c03"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 20:57:44.683250 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.683171 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842066df-e494-45bd-a3af-4531689a0c03-kube-api-access-qzmvd" (OuterVolumeSpecName: "kube-api-access-qzmvd") pod "842066df-e494-45bd-a3af-4531689a0c03" (UID: "842066df-e494-45bd-a3af-4531689a0c03"). InnerVolumeSpecName "kube-api-access-qzmvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 20:57:44.782649 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.782607 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-oauth-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:44.782649 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.782640 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:44.782649 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.782651 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-service-ca\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:44.782649 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.782660 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/842066df-e494-45bd-a3af-4531689a0c03-console-oauth-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:44.782918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.782670 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzmvd\" (UniqueName: \"kubernetes.io/projected/842066df-e494-45bd-a3af-4531689a0c03-kube-api-access-qzmvd\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:44.782918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.782680 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-trusted-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:44.782918 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:44.782688 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/842066df-e494-45bd-a3af-4531689a0c03-console-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 20:57:45.435051 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.435015 2563 generic.go:356] "Generic (PLEG): container finished" podID="842066df-e494-45bd-a3af-4531689a0c03" containerID="b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9" exitCode=0 Sep 10 20:57:45.435511 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.435082 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588596f558-pfzd2" Sep 10 20:57:45.435511 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.435104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588596f558-pfzd2" event={"ID":"842066df-e494-45bd-a3af-4531689a0c03","Type":"ContainerDied","Data":"b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9"} Sep 10 20:57:45.435511 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.435162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588596f558-pfzd2" event={"ID":"842066df-e494-45bd-a3af-4531689a0c03","Type":"ContainerDied","Data":"7fe96ac2135eef3376bd3fb76a6db02c30db157f7ac89c9268e18f1fa547bb16"} Sep 10 20:57:45.435511 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.435186 2563 scope.go:117] "RemoveContainer" containerID="b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9" Sep 10 20:57:45.443612 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.443591 2563 scope.go:117] "RemoveContainer" containerID="b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9" Sep 10 20:57:45.443866 ip-10-0-142-97 kubenswrapper[2563]: E0910 20:57:45.443848 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9\": container with ID starting with b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9 not found: ID does not exist" containerID="b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9" Sep 10 20:57:45.443922 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.443876 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9"} err="failed to get container status \"b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9\": rpc error: code = NotFound desc = could not find container \"b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9\": container with ID starting with b1e58b8924f87476290c193bcb3e2c925f083653c1fc4ea61a0350aa8d72f8d9 not found: ID does not exist" Sep 10 20:57:45.449115 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.449094 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588596f558-pfzd2"] Sep 10 20:57:45.451979 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:45.451960 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-588596f558-pfzd2"] Sep 10 20:57:47.325543 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:57:47.325506 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842066df-e494-45bd-a3af-4531689a0c03" path="/var/lib/kubelet/pods/842066df-e494-45bd-a3af-4531689a0c03/volumes" Sep 10 20:58:09.649633 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:09.649598 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:58:09.665029 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:09.665001 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:58:10.551614 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:10.551583 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 20:58:23.286540 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.286505 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hg94f"] Sep 10 20:58:23.286970 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.286861 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842066df-e494-45bd-a3af-4531689a0c03" containerName="console" Sep 10 20:58:23.286970 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.286873 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="842066df-e494-45bd-a3af-4531689a0c03" containerName="console" Sep 10 20:58:23.286970 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.286936 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="842066df-e494-45bd-a3af-4531689a0c03" containerName="console" Sep 10 20:58:23.291161 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.291137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.293423 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.293384 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 20:58:23.293588 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.293473 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 20:58:23.294050 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.294030 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5jjp7\"" Sep 10 20:58:23.297869 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.297841 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hg94f"] Sep 10 20:58:23.329881 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.329849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585aebc2-e396-4e62-9da1-36715d7990bd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hg94f\" (UID: \"585aebc2-e396-4e62-9da1-36715d7990bd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.330042 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.329948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b96x\" (UniqueName: \"kubernetes.io/projected/585aebc2-e396-4e62-9da1-36715d7990bd-kube-api-access-5b96x\") pod \"cert-manager-cainjector-559cdd8c87-hg94f\" (UID: \"585aebc2-e396-4e62-9da1-36715d7990bd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.430367 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.430329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b96x\" (UniqueName: \"kubernetes.io/projected/585aebc2-e396-4e62-9da1-36715d7990bd-kube-api-access-5b96x\") pod \"cert-manager-cainjector-559cdd8c87-hg94f\" (UID: \"585aebc2-e396-4e62-9da1-36715d7990bd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.430499 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.430410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585aebc2-e396-4e62-9da1-36715d7990bd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hg94f\" (UID: \"585aebc2-e396-4e62-9da1-36715d7990bd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.438072 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.438039 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/585aebc2-e396-4e62-9da1-36715d7990bd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hg94f\" (UID: \"585aebc2-e396-4e62-9da1-36715d7990bd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.438265 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.438244 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b96x\" (UniqueName: \"kubernetes.io/projected/585aebc2-e396-4e62-9da1-36715d7990bd-kube-api-access-5b96x\") pod \"cert-manager-cainjector-559cdd8c87-hg94f\" (UID: \"585aebc2-e396-4e62-9da1-36715d7990bd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.615284 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.615188 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" Sep 10 20:58:23.885947 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:23.885860 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hg94f"] Sep 10 20:58:23.889319 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:58:23.889291 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod585aebc2_e396_4e62_9da1_36715d7990bd.slice/crio-3e976b2af82309ffdae105f3c9523058f71199b5e27c7a3756aaca59f92b4ab8 WatchSource:0}: Error finding container 3e976b2af82309ffdae105f3c9523058f71199b5e27c7a3756aaca59f92b4ab8: Status 404 returned error can't find the container with id 3e976b2af82309ffdae105f3c9523058f71199b5e27c7a3756aaca59f92b4ab8 Sep 10 20:58:24.595555 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:24.595510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" event={"ID":"585aebc2-e396-4e62-9da1-36715d7990bd","Type":"ContainerStarted","Data":"3e976b2af82309ffdae105f3c9523058f71199b5e27c7a3756aaca59f92b4ab8"} Sep 10 20:58:27.612954 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:27.612919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" event={"ID":"585aebc2-e396-4e62-9da1-36715d7990bd","Type":"ContainerStarted","Data":"bb783b59e2b26d04467f6f33caee73e74ca92a2b068efce44b072c5c7b909b0d"} Sep 10 20:58:27.630491 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:27.630440 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hg94f" podStartSLOduration=1.59910314 podStartE2EDuration="4.63042323s" totalImagesPullingTime="3.03132009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:27.629931663 +0000 UTC m=+226.844487147" watchObservedRunningTime="2026-09-10 20:58:27.63042323 +0000 UTC m=+226.844978517" Sep 10 20:58:32.649624 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.649593 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jt2bg"] Sep 10 20:58:32.652809 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.652794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:32.654718 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.654702 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sgc6b\"" Sep 10 20:58:32.661738 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.661715 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jt2bg"] Sep 10 20:58:32.713676 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.713642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/beac4fbf-6fe8-4115-b0a5-0ec90972ec02-bound-sa-token\") pod \"cert-manager-55b4d954d5-jt2bg\" (UID: \"beac4fbf-6fe8-4115-b0a5-0ec90972ec02\") " pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:32.713853 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.713682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbr7s\" (UniqueName: \"kubernetes.io/projected/beac4fbf-6fe8-4115-b0a5-0ec90972ec02-kube-api-access-cbr7s\") pod \"cert-manager-55b4d954d5-jt2bg\" (UID: \"beac4fbf-6fe8-4115-b0a5-0ec90972ec02\") " pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:32.815028 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.814996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/beac4fbf-6fe8-4115-b0a5-0ec90972ec02-bound-sa-token\") pod \"cert-manager-55b4d954d5-jt2bg\" (UID: \"beac4fbf-6fe8-4115-b0a5-0ec90972ec02\") " pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:32.815028 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.815037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbr7s\" (UniqueName: \"kubernetes.io/projected/beac4fbf-6fe8-4115-b0a5-0ec90972ec02-kube-api-access-cbr7s\") pod \"cert-manager-55b4d954d5-jt2bg\" (UID: \"beac4fbf-6fe8-4115-b0a5-0ec90972ec02\") " pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:32.823303 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.823266 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/beac4fbf-6fe8-4115-b0a5-0ec90972ec02-bound-sa-token\") pod \"cert-manager-55b4d954d5-jt2bg\" (UID: \"beac4fbf-6fe8-4115-b0a5-0ec90972ec02\") " pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:32.823415 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.823381 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbr7s\" (UniqueName: \"kubernetes.io/projected/beac4fbf-6fe8-4115-b0a5-0ec90972ec02-kube-api-access-cbr7s\") pod \"cert-manager-55b4d954d5-jt2bg\" (UID: \"beac4fbf-6fe8-4115-b0a5-0ec90972ec02\") " pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:32.962181 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:32.962088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jt2bg" Sep 10 20:58:33.231216 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:33.231191 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jt2bg"] Sep 10 20:58:33.233428 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:58:33.233396 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeac4fbf_6fe8_4115_b0a5_0ec90972ec02.slice/crio-c6061d3230d763a11c086454e0fba641c2a363d8f8588fee385e6c8c14a7b093 WatchSource:0}: Error finding container c6061d3230d763a11c086454e0fba641c2a363d8f8588fee385e6c8c14a7b093: Status 404 returned error can't find the container with id c6061d3230d763a11c086454e0fba641c2a363d8f8588fee385e6c8c14a7b093 Sep 10 20:58:33.639408 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:33.639314 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jt2bg" event={"ID":"beac4fbf-6fe8-4115-b0a5-0ec90972ec02","Type":"ContainerStarted","Data":"0aa0787e5b0e66c907a8554c849f293417ced47884816abb57c14f93676b0467"} Sep 10 20:58:33.639408 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:33.639363 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jt2bg" event={"ID":"beac4fbf-6fe8-4115-b0a5-0ec90972ec02","Type":"ContainerStarted","Data":"c6061d3230d763a11c086454e0fba641c2a363d8f8588fee385e6c8c14a7b093"} Sep 10 20:58:33.656103 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:33.656050 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jt2bg" podStartSLOduration=1.656034698 podStartE2EDuration="1.656034698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:33.654075585 +0000 UTC m=+232.868630867" watchObservedRunningTime="2026-09-10 20:58:33.656034698 +0000 UTC m=+232.870589985" Sep 10 20:58:56.450879 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.450845 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg"] Sep 10 20:58:56.455243 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.455224 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.458136 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.458107 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 20:58:56.458268 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.458138 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 20:58:56.458268 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.458138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 20:58:56.458268 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.458226 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 20:58:56.458268 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.458147 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 20:58:56.458505 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.458144 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wzv66\"" Sep 10 20:58:56.464032 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.464000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg"] Sep 10 20:58:56.525720 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.525685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zp9c\" (UniqueName: \"kubernetes.io/projected/c728931b-9d8e-4111-81aa-e9734def6a1e-kube-api-access-4zp9c\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.525902 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.525739 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c728931b-9d8e-4111-81aa-e9734def6a1e-cert\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.525902 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.525756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c728931b-9d8e-4111-81aa-e9734def6a1e-metrics-cert\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.525902 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.525815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c728931b-9d8e-4111-81aa-e9734def6a1e-manager-config\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.626956 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.626918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c728931b-9d8e-4111-81aa-e9734def6a1e-cert\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.626956 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.626953 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c728931b-9d8e-4111-81aa-e9734def6a1e-metrics-cert\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.627199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.626983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c728931b-9d8e-4111-81aa-e9734def6a1e-manager-config\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.627199 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.627048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zp9c\" (UniqueName: \"kubernetes.io/projected/c728931b-9d8e-4111-81aa-e9734def6a1e-kube-api-access-4zp9c\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.627782 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.627749 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c728931b-9d8e-4111-81aa-e9734def6a1e-manager-config\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.629389 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.629369 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c728931b-9d8e-4111-81aa-e9734def6a1e-cert\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.629494 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.629435 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c728931b-9d8e-4111-81aa-e9734def6a1e-metrics-cert\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.637775 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.637748 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zp9c\" (UniqueName: \"kubernetes.io/projected/c728931b-9d8e-4111-81aa-e9734def6a1e-kube-api-access-4zp9c\") pod \"lws-controller-manager-6ffd7f7887-4cbxg\" (UID: \"c728931b-9d8e-4111-81aa-e9734def6a1e\") " pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:56.765253 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:56.765214 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:57.037259 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:57.037179 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg"] Sep 10 20:58:57.040647 ip-10-0-142-97 kubenswrapper[2563]: W0910 20:58:57.040619 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc728931b_9d8e_4111_81aa_e9734def6a1e.slice/crio-c1bafdd42771318015da2c2389cb93dc926c881b7daa2c04303671955d1e3fcb WatchSource:0}: Error finding container c1bafdd42771318015da2c2389cb93dc926c881b7daa2c04303671955d1e3fcb: Status 404 returned error can't find the container with id c1bafdd42771318015da2c2389cb93dc926c881b7daa2c04303671955d1e3fcb Sep 10 20:58:57.740645 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:57.740598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" event={"ID":"c728931b-9d8e-4111-81aa-e9734def6a1e","Type":"ContainerStarted","Data":"c1bafdd42771318015da2c2389cb93dc926c881b7daa2c04303671955d1e3fcb"} Sep 10 20:58:59.750896 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:59.750852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" event={"ID":"c728931b-9d8e-4111-81aa-e9734def6a1e","Type":"ContainerStarted","Data":"0fd10c01aad3fec1b0bf5bd53955f9060f5a06d8e6496028cfd00e230e046008"} Sep 10 20:58:59.751338 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:59.750938 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:58:59.766196 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:58:59.766134 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" podStartSLOduration=1.38658706 podStartE2EDuration="3.766112677s" totalImagesPullingTime="2.379525617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:59.764992825 +0000 UTC m=+258.979548112" watchObservedRunningTime="2026-09-10 20:58:59.766112677 +0000 UTC m=+258.980667967" Sep 10 20:59:10.757461 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:59:10.757388 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6ffd7f7887-4cbxg" Sep 10 20:59:41.195038 ip-10-0-142-97 kubenswrapper[2563]: I0910 20:59:41.195010 2563 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 21:00:03.538700 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.538664 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq"] Sep 10 21:00:03.544535 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.544510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.546978 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.546940 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 21:00:03.547138 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.547084 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 21:00:03.547138 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.547090 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-76gml\"" Sep 10 21:00:03.547241 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.547156 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 21:00:03.551640 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.551614 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq"] Sep 10 21:00:03.644327 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-workload-certs\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644327 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-workload-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644627 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-podinfo\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644627 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-data\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644627 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-token\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644761 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wfj4\" (UniqueName: \"kubernetes.io/projected/5b9b5270-6010-43fc-aea7-078f87a7a198-kube-api-access-2wfj4\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644761 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b5270-6010-43fc-aea7-078f87a7a198-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644761 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-envoy\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.644761 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.644734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-credential-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745518 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745476 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-podinfo\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-data\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-token\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wfj4\" (UniqueName: \"kubernetes.io/projected/5b9b5270-6010-43fc-aea7-078f87a7a198-kube-api-access-2wfj4\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b5270-6010-43fc-aea7-078f87a7a198-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-envoy\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-credential-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-workload-certs\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.745951 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.745866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-workload-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.746373 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.746020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-data\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.746373 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.746242 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-workload-certs\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.746373 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.746283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-workload-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.746373 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.746296 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-credential-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.746532 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.746460 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b5270-6010-43fc-aea7-078f87a7a198-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.748070 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.748051 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-envoy\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.748205 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.748189 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-podinfo\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.753245 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.753220 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b5270-6010-43fc-aea7-078f87a7a198-istio-token\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.753441 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.753420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wfj4\" (UniqueName: \"kubernetes.io/projected/5b9b5270-6010-43fc-aea7-078f87a7a198-kube-api-access-2wfj4\") pod \"maas-default-gateway-openshift-default-697c686cf6-hlwbq\" (UID: \"5b9b5270-6010-43fc-aea7-078f87a7a198\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:03.856861 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:03.856752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:04.134188 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:04.134163 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq"] Sep 10 21:00:04.136110 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:00:04.136078 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9b5270_6010_43fc_aea7_078f87a7a198.slice/crio-45e6f0b291a5d65f04eea1da888dccbc92b7f5ed9db7d7c36d60a9d9a36e3f92 WatchSource:0}: Error finding container 45e6f0b291a5d65f04eea1da888dccbc92b7f5ed9db7d7c36d60a9d9a36e3f92: Status 404 returned error can't find the container with id 45e6f0b291a5d65f04eea1da888dccbc92b7f5ed9db7d7c36d60a9d9a36e3f92 Sep 10 21:00:04.138185 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:04.138166 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 21:00:05.021288 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:05.021253 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerStarted","Data":"45e6f0b291a5d65f04eea1da888dccbc92b7f5ed9db7d7c36d60a9d9a36e3f92"} Sep 10 21:00:09.235621 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:09.235582 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:00:09.236007 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:09.235675 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:00:09.236007 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:09.235738 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:00:10.049631 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:10.049592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerStarted","Data":"f559c03f08cddf726abcbe2fb88d9ee7d5edb8e483e795b1939ff3ebd271d1cf"} Sep 10 21:00:10.068436 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:10.068387 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podStartSLOduration=1.971357177 podStartE2EDuration="7.068371514s" totalImagesPullingTime="5.097014337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:10.066917739 +0000 UTC m=+329.281473027" watchObservedRunningTime="2026-09-10 21:00:10.068371514 +0000 UTC m=+329.282926802" Sep 10 21:00:10.856942 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:10.856906 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:10.858379 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:10.858349 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:10.858441 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:10.858406 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:11.858004 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:11.857965 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:11.858409 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:11.858022 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:12.857997 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:12.857956 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:12.858182 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:12.858018 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:13.858217 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:13.858182 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:13.858622 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:13.858256 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:14.857366 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:14.857332 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:14.857531 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:14.857388 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:15.508469 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.508435 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bkwh6"] Sep 10 21:00:15.512082 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.512057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:00:15.514273 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.514236 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 21:00:15.514836 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.514821 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 21:00:15.514932 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.514825 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r644d\"" Sep 10 21:00:15.518464 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.518439 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bkwh6"] Sep 10 21:00:15.657135 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.657094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bgrj\" (UniqueName: \"kubernetes.io/projected/53cb9d4c-6b4c-4b7f-a083-d161b52fc276-kube-api-access-8bgrj\") pod \"authorino-7bcfd8f9cd-bkwh6\" (UID: \"53cb9d4c-6b4c-4b7f-a083-d161b52fc276\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:00:15.757870 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.757813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bgrj\" (UniqueName: \"kubernetes.io/projected/53cb9d4c-6b4c-4b7f-a083-d161b52fc276-kube-api-access-8bgrj\") pod \"authorino-7bcfd8f9cd-bkwh6\" (UID: \"53cb9d4c-6b4c-4b7f-a083-d161b52fc276\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:00:15.765975 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.765894 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bgrj\" (UniqueName: \"kubernetes.io/projected/53cb9d4c-6b4c-4b7f-a083-d161b52fc276-kube-api-access-8bgrj\") pod \"authorino-7bcfd8f9cd-bkwh6\" (UID: \"53cb9d4c-6b4c-4b7f-a083-d161b52fc276\") " pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:00:15.822863 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.822825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:00:15.857574 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.857535 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:15.857727 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:15.857641 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:16.091207 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:16.091101 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bkwh6"] Sep 10 21:00:16.093962 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:00:16.093934 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53cb9d4c_6b4c_4b7f_a083_d161b52fc276.slice/crio-fe63cf1e4cdd6c3698e4d26ea18d3eef337c9379cd70c815847d93478f5467a1 WatchSource:0}: Error finding container fe63cf1e4cdd6c3698e4d26ea18d3eef337c9379cd70c815847d93478f5467a1: Status 404 returned error can't find the container with id fe63cf1e4cdd6c3698e4d26ea18d3eef337c9379cd70c815847d93478f5467a1 Sep 10 21:00:16.857494 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:16.857458 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:16.857920 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:16.857514 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:17.079613 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:17.079558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" event={"ID":"53cb9d4c-6b4c-4b7f-a083-d161b52fc276","Type":"ContainerStarted","Data":"fe63cf1e4cdd6c3698e4d26ea18d3eef337c9379cd70c815847d93478f5467a1"} Sep 10 21:00:17.857677 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:17.857635 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:17.858066 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:17.857726 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:18.857751 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:18.857688 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:18.858160 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:18.858033 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:18.858160 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:18.858091 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:19.857982 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:19.857946 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:19.858464 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:19.858009 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:20.857167 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:20.857129 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:20.857340 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:20.857185 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:21.858094 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:21.858056 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:21.858610 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:21.858125 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:22.857607 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:22.857540 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:22.857882 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:22.857629 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:23.857841 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:23.857803 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:23.858228 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:23.857862 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:24.857763 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:24.857723 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:24.857976 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:24.857790 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:25.857630 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:25.857587 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:25.857838 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:25.857652 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:26.857339 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:26.857295 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:26.857975 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:26.857368 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:27.857636 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:27.857596 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:27.858075 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:27.857668 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:28.857232 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:28.857129 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:28.857232 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:28.857194 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:29.133248 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:29.133153 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" event={"ID":"53cb9d4c-6b4c-4b7f-a083-d161b52fc276","Type":"ContainerStarted","Data":"8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0"} Sep 10 21:00:29.149960 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:29.149891 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" podStartSLOduration=1.690665445 podStartE2EDuration="14.149872353s" totalImagesPullingTime="12.459206908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:29.148517012 +0000 UTC m=+348.363072300" watchObservedRunningTime="2026-09-10 21:00:29.149872353 +0000 UTC m=+348.364427640" Sep 10 21:00:29.857459 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:29.857415 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:29.857661 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:29.857480 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:30.857484 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:30.857447 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:30.857888 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:30.857533 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:31.858117 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:31.858078 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:31.858505 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:31.858136 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:32.857870 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:32.857828 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:32.858059 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:32.857889 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:33.857972 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:33.857932 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:33.858402 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:33.858001 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:34.857461 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:34.857421 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:34.857677 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:34.857495 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:35.857320 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:35.857281 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:35.857727 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:35.857338 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:36.858189 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:36.858143 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:36.858613 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:36.858205 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:37.858205 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:37.858155 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:37.858612 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:37.858217 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:38.857264 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:38.857218 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:38.857446 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:38.857297 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:39.857508 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:39.857469 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:39.857947 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:39.857546 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:39.857947 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:39.857621 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:39.858138 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:39.858120 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="istio-proxy" containerStatusID={"Type":"cri-o","ID":"f559c03f08cddf726abcbe2fb88d9ee7d5edb8e483e795b1939ff3ebd271d1cf"} pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" containerMessage="Container istio-proxy failed startup probe, will be restarted" Sep 10 21:00:39.858176 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:39.858157 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" containerID="cri-o://f559c03f08cddf726abcbe2fb88d9ee7d5edb8e483e795b1939ff3ebd271d1cf" gracePeriod=30 Sep 10 21:00:40.012848 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.012810 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-856777497b-k5bwk"] Sep 10 21:00:40.022979 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.022945 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.026841 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.026801 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856777497b-k5bwk"] Sep 10 21:00:40.078819 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.078780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-trusted-ca-bundle\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.078819 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.078830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-console-config\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.079031 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.078893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-oauth-serving-cert\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.079031 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.078929 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b89f84db-b76e-4174-9a11-8c4633cc9548-console-serving-cert\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.079031 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.078961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b89f84db-b76e-4174-9a11-8c4633cc9548-console-oauth-config\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.079031 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.078981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-service-ca\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.079031 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.079025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx92s\" (UniqueName: \"kubernetes.io/projected/b89f84db-b76e-4174-9a11-8c4633cc9548-kube-api-access-hx92s\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.180150 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.180058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b89f84db-b76e-4174-9a11-8c4633cc9548-console-serving-cert\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.180150 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.180104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b89f84db-b76e-4174-9a11-8c4633cc9548-console-oauth-config\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.180385 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.180210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-service-ca\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.180385 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.180257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx92s\" (UniqueName: \"kubernetes.io/projected/b89f84db-b76e-4174-9a11-8c4633cc9548-kube-api-access-hx92s\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.180385 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.180333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-trusted-ca-bundle\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.180643 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.180490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-console-config\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.180952 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.180924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-oauth-serving-cert\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.181085 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.181046 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-service-ca\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.181254 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.181230 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-trusted-ca-bundle\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.181343 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.181244 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-console-config\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.181462 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.181442 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b89f84db-b76e-4174-9a11-8c4633cc9548-oauth-serving-cert\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.182966 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.182945 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b89f84db-b76e-4174-9a11-8c4633cc9548-console-serving-cert\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.183075 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.183058 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b89f84db-b76e-4174-9a11-8c4633cc9548-console-oauth-config\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.187708 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.187688 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx92s\" (UniqueName: \"kubernetes.io/projected/b89f84db-b76e-4174-9a11-8c4633cc9548-kube-api-access-hx92s\") pod \"console-856777497b-k5bwk\" (UID: \"b89f84db-b76e-4174-9a11-8c4633cc9548\") " pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.333915 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.333873 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:40.606032 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:40.606009 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856777497b-k5bwk"] Sep 10 21:00:40.608419 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:00:40.608387 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89f84db_b76e_4174_9a11_8c4633cc9548.slice/crio-b6da4f0d841584fcb4b98381d2139bc0971da0a3e507890e7ff0727937ebd826 WatchSource:0}: Error finding container b6da4f0d841584fcb4b98381d2139bc0971da0a3e507890e7ff0727937ebd826: Status 404 returned error can't find the container with id b6da4f0d841584fcb4b98381d2139bc0971da0a3e507890e7ff0727937ebd826 Sep 10 21:00:41.187921 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:41.187877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856777497b-k5bwk" event={"ID":"b89f84db-b76e-4174-9a11-8c4633cc9548","Type":"ContainerStarted","Data":"f489eb93582a6d1c82099c7655ed05e0e2705d012eaf522a7ba4ca134f144e28"} Sep 10 21:00:41.188332 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:41.187943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856777497b-k5bwk" event={"ID":"b89f84db-b76e-4174-9a11-8c4633cc9548","Type":"ContainerStarted","Data":"b6da4f0d841584fcb4b98381d2139bc0971da0a3e507890e7ff0727937ebd826"} Sep 10 21:00:41.208099 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:41.208044 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-856777497b-k5bwk" podStartSLOduration=2.208027299 podStartE2EDuration="2.208027299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:41.20651526 +0000 UTC m=+360.421070549" watchObservedRunningTime="2026-09-10 21:00:41.208027299 +0000 UTC m=+360.422582587" Sep 10 21:00:44.975170 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:44.975137 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:00:44.975429 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:44.975212 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:00:44.975429 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:44.975248 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:00:45.207100 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:45.207008 2563 generic.go:356] "Generic (PLEG): container finished" podID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerID="f559c03f08cddf726abcbe2fb88d9ee7d5edb8e483e795b1939ff3ebd271d1cf" exitCode=0 Sep 10 21:00:45.207228 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:45.207089 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerDied","Data":"f559c03f08cddf726abcbe2fb88d9ee7d5edb8e483e795b1939ff3ebd271d1cf"} Sep 10 21:00:45.207228 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:45.207146 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerStarted","Data":"5da0b2e93b755bd98d9846d664b250c6d4717c3a4eef02fc0a8f0bb2e4c39269"} Sep 10 21:00:45.857763 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:45.857720 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:46.857667 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:46.857626 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:46.858066 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:46.857684 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:47.857396 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:47.857356 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:47.857605 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:47.857420 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:48.857879 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:48.857841 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:00:48.858259 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:48.858200 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:48.858325 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:48.858269 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:49.857536 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:49.857492 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:49.857753 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:49.857556 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:50.334822 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:50.334781 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:50.335322 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:50.334843 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:50.339755 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:50.339730 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:50.858116 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:50.858072 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:50.858427 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:50.858152 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:51.238787 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:51.238756 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-856777497b-k5bwk" Sep 10 21:00:51.285500 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:51.285468 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f56df9fd-8mlzg"] Sep 10 21:00:51.857457 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:51.857418 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:51.857947 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:51.857483 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:52.857378 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:52.857339 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:52.857556 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:52.857402 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:53.858004 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:53.857963 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:53.858394 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:53.858023 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:54.857724 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:54.857686 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:54.857918 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:54.857743 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:55.857639 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:55.857601 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:55.858052 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:55.857661 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:56.857666 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:56.857622 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:56.858065 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:56.857687 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:57.857447 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:57.857407 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:57.857647 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:57.857478 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:58.857754 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:58.857713 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:58.858140 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:58.857774 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:00:59.857327 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:59.857290 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:00:59.857504 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:00:59.857348 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:00.857737 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:00.857699 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:00.858118 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:00.857772 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:01.857261 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:01.857221 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:01.857446 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:01.857278 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:02.857972 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:02.857938 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:02.858358 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:02.857995 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:03.857754 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:03.857716 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:03.857949 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:03.857773 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:04.857648 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:04.857608 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:04.858034 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:04.857690 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:05.858015 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:05.857974 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:05.858388 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:05.858039 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:06.857223 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:06.857189 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:06.857399 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:06.857243 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:07.857933 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:07.857896 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:07.858307 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:07.857953 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:08.857420 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:08.857375 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:08.857614 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:08.857465 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:09.857424 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:09.857385 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:09.857830 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:09.857453 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:10.857700 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:10.857661 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:10.858096 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:10.857737 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:11.857663 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:11.857620 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:11.857883 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:11.857685 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:12.500306 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.499896 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bkwh6"] Sep 10 21:01:12.500306 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.500131 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" containerName="authorino" containerID="cri-o://8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0" gracePeriod=2 Sep 10 21:01:12.502033 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:01:12.501994 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"authorino-7bcfd8f9cd-bkwh6\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:01:12.502156 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.502135 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-bkwh6"] Sep 10 21:01:12.524840 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.524814 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-l4hk8"] Sep 10 21:01:12.525212 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.525198 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" containerName="authorino" Sep 10 21:01:12.525263 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.525214 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" containerName="authorino" Sep 10 21:01:12.525303 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.525285 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" containerName="authorino" Sep 10 21:01:12.527116 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.527096 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" Sep 10 21:01:12.528952 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:01:12.528927 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"authorino-7bcfd8f9cd-bkwh6\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:01:12.540322 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.540262 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-l4hk8"] Sep 10 21:01:12.603977 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.603941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4vgr\" (UniqueName: \"kubernetes.io/projected/e38f42e3-9b8f-4b10-8fca-2d72a969a918-kube-api-access-t4vgr\") pod \"authorino-7bcfd8f9cd-l4hk8\" (UID: \"e38f42e3-9b8f-4b10-8fca-2d72a969a918\") " pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" Sep 10 21:01:12.705272 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.705236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4vgr\" (UniqueName: \"kubernetes.io/projected/e38f42e3-9b8f-4b10-8fca-2d72a969a918-kube-api-access-t4vgr\") pod \"authorino-7bcfd8f9cd-l4hk8\" (UID: \"e38f42e3-9b8f-4b10-8fca-2d72a969a918\") " pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" Sep 10 21:01:12.714196 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.714167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4vgr\" (UniqueName: \"kubernetes.io/projected/e38f42e3-9b8f-4b10-8fca-2d72a969a918-kube-api-access-t4vgr\") pod \"authorino-7bcfd8f9cd-l4hk8\" (UID: \"e38f42e3-9b8f-4b10-8fca-2d72a969a918\") " pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" Sep 10 21:01:12.741948 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.741925 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:01:12.744040 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:01:12.744016 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"authorino-7bcfd8f9cd-bkwh6\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:01:12.806636 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.806531 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bgrj\" (UniqueName: \"kubernetes.io/projected/53cb9d4c-6b4c-4b7f-a083-d161b52fc276-kube-api-access-8bgrj\") pod \"53cb9d4c-6b4c-4b7f-a083-d161b52fc276\" (UID: \"53cb9d4c-6b4c-4b7f-a083-d161b52fc276\") " Sep 10 21:01:12.808732 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.808709 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cb9d4c-6b4c-4b7f-a083-d161b52fc276-kube-api-access-8bgrj" (OuterVolumeSpecName: "kube-api-access-8bgrj") pod "53cb9d4c-6b4c-4b7f-a083-d161b52fc276" (UID: "53cb9d4c-6b4c-4b7f-a083-d161b52fc276"). InnerVolumeSpecName "kube-api-access-8bgrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 21:01:12.858097 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.858064 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:12.858458 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.858120 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:12.867219 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.867194 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" Sep 10 21:01:12.907856 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:12.907811 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bgrj\" (UniqueName: \"kubernetes.io/projected/53cb9d4c-6b4c-4b7f-a083-d161b52fc276-kube-api-access-8bgrj\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:13.151957 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.151860 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-l4hk8"] Sep 10 21:01:13.155843 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:01:13.155809 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode38f42e3_9b8f_4b10_8fca_2d72a969a918.slice/crio-32396ebad105a747290e208ac32d51279d23e20828ca4f53afaffe122a6b17d7 WatchSource:0}: Error finding container 32396ebad105a747290e208ac32d51279d23e20828ca4f53afaffe122a6b17d7: Status 404 returned error can't find the container with id 32396ebad105a747290e208ac32d51279d23e20828ca4f53afaffe122a6b17d7 Sep 10 21:01:13.326006 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.325966 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" path="/var/lib/kubelet/pods/53cb9d4c-6b4c-4b7f-a083-d161b52fc276/volumes" Sep 10 21:01:13.340699 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.340666 2563 generic.go:356] "Generic (PLEG): container finished" podID="53cb9d4c-6b4c-4b7f-a083-d161b52fc276" containerID="8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0" exitCode=0 Sep 10 21:01:13.340861 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.340707 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-bkwh6" Sep 10 21:01:13.340861 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.340765 2563 scope.go:117] "RemoveContainer" containerID="8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0" Sep 10 21:01:13.342092 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.342070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" event={"ID":"e38f42e3-9b8f-4b10-8fca-2d72a969a918","Type":"ContainerStarted","Data":"32396ebad105a747290e208ac32d51279d23e20828ca4f53afaffe122a6b17d7"} Sep 10 21:01:13.349403 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.349384 2563 scope.go:117] "RemoveContainer" containerID="8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0" Sep 10 21:01:13.349797 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:01:13.349772 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0\": container with ID starting with 8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0 not found: ID does not exist" containerID="8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0" Sep 10 21:01:13.349903 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.349806 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0"} err="failed to get container status \"8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0\": rpc error: code = NotFound desc = could not find container \"8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0\": container with ID starting with 8cfae47073f4c9d708bd6b0424796708350d6b79835c70e63560402f36a6d7e0 not found: ID does not exist" Sep 10 21:01:13.857377 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.857349 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:13.857496 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:13.857406 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:14.348491 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:14.348453 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" event={"ID":"e38f42e3-9b8f-4b10-8fca-2d72a969a918","Type":"ContainerStarted","Data":"49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742"} Sep 10 21:01:14.367477 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:14.367433 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" podStartSLOduration=1.740302064 podStartE2EDuration="2.367415589s" totalImagesPullingTime="627.113525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:01:14.366362377 +0000 UTC m=+393.580917665" watchObservedRunningTime="2026-09-10 21:01:14.367415589 +0000 UTC m=+393.581970878" Sep 10 21:01:14.857422 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:14.857390 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:14.857619 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:14.857446 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:15.857438 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:15.857400 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:15.857871 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:15.857455 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:15.857871 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:15.857495 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:01:15.857994 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:15.857975 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="istio-proxy" containerStatusID={"Type":"cri-o","ID":"5da0b2e93b755bd98d9846d664b250c6d4717c3a4eef02fc0a8f0bb2e4c39269"} pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" containerMessage="Container istio-proxy failed startup probe, will be restarted" Sep 10 21:01:15.858036 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:15.858015 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" containerID="cri-o://5da0b2e93b755bd98d9846d664b250c6d4717c3a4eef02fc0a8f0bb2e4c39269" gracePeriod=30 Sep 10 21:01:16.307684 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.307636 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57f56df9fd-8mlzg" podUID="cfe952a2-beba-4149-89ff-a935e2fc1aed" containerName="console" containerID="cri-o://28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139" gracePeriod=15 Sep 10 21:01:16.546907 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.546880 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 21:01:16.642208 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642118 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-oauth-config\") pod \"cfe952a2-beba-4149-89ff-a935e2fc1aed\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " Sep 10 21:01:16.642208 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642161 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-oauth-serving-cert\") pod \"cfe952a2-beba-4149-89ff-a935e2fc1aed\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " Sep 10 21:01:16.642208 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642193 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-serving-cert\") pod \"cfe952a2-beba-4149-89ff-a935e2fc1aed\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " Sep 10 21:01:16.642208 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642209 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb2m8\" (UniqueName: \"kubernetes.io/projected/cfe952a2-beba-4149-89ff-a935e2fc1aed-kube-api-access-kb2m8\") pod \"cfe952a2-beba-4149-89ff-a935e2fc1aed\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " Sep 10 21:01:16.642518 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642328 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-service-ca\") pod \"cfe952a2-beba-4149-89ff-a935e2fc1aed\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " Sep 10 21:01:16.642518 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642385 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-trusted-ca-bundle\") pod \"cfe952a2-beba-4149-89ff-a935e2fc1aed\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " Sep 10 21:01:16.642518 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642422 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-config\") pod \"cfe952a2-beba-4149-89ff-a935e2fc1aed\" (UID: \"cfe952a2-beba-4149-89ff-a935e2fc1aed\") " Sep 10 21:01:16.642733 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642701 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cfe952a2-beba-4149-89ff-a935e2fc1aed" (UID: "cfe952a2-beba-4149-89ff-a935e2fc1aed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 21:01:16.642733 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642716 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-service-ca" (OuterVolumeSpecName: "service-ca") pod "cfe952a2-beba-4149-89ff-a935e2fc1aed" (UID: "cfe952a2-beba-4149-89ff-a935e2fc1aed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 21:01:16.642845 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642803 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-oauth-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:16.642845 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642805 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cfe952a2-beba-4149-89ff-a935e2fc1aed" (UID: "cfe952a2-beba-4149-89ff-a935e2fc1aed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 21:01:16.642845 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.642823 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-service-ca\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:16.643041 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.643020 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-config" (OuterVolumeSpecName: "console-config") pod "cfe952a2-beba-4149-89ff-a935e2fc1aed" (UID: "cfe952a2-beba-4149-89ff-a935e2fc1aed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 21:01:16.644449 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.644423 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cfe952a2-beba-4149-89ff-a935e2fc1aed" (UID: "cfe952a2-beba-4149-89ff-a935e2fc1aed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 21:01:16.644449 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.644436 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe952a2-beba-4149-89ff-a935e2fc1aed-kube-api-access-kb2m8" (OuterVolumeSpecName: "kube-api-access-kb2m8") pod "cfe952a2-beba-4149-89ff-a935e2fc1aed" (UID: "cfe952a2-beba-4149-89ff-a935e2fc1aed"). InnerVolumeSpecName "kube-api-access-kb2m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 21:01:16.644600 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.644450 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cfe952a2-beba-4149-89ff-a935e2fc1aed" (UID: "cfe952a2-beba-4149-89ff-a935e2fc1aed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 21:01:16.743909 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.743867 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-oauth-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:16.743909 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.743899 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-serving-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:16.743909 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.743909 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb2m8\" (UniqueName: \"kubernetes.io/projected/cfe952a2-beba-4149-89ff-a935e2fc1aed-kube-api-access-kb2m8\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:16.743909 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.743919 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-trusted-ca-bundle\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:16.744186 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:16.743928 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfe952a2-beba-4149-89ff-a935e2fc1aed-console-config\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:17.364136 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.364101 2563 generic.go:356] "Generic (PLEG): container finished" podID="cfe952a2-beba-4149-89ff-a935e2fc1aed" containerID="28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139" exitCode=0 Sep 10 21:01:17.364534 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.364154 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f56df9fd-8mlzg" Sep 10 21:01:17.364534 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.364168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f56df9fd-8mlzg" event={"ID":"cfe952a2-beba-4149-89ff-a935e2fc1aed","Type":"ContainerDied","Data":"28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139"} Sep 10 21:01:17.364534 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.364228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f56df9fd-8mlzg" event={"ID":"cfe952a2-beba-4149-89ff-a935e2fc1aed","Type":"ContainerDied","Data":"3cb9bc014638bca6a39aa4c012d00faf9a6671f1576ccb09e6976475e03d2095"} Sep 10 21:01:17.364534 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.364254 2563 scope.go:117] "RemoveContainer" containerID="28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139" Sep 10 21:01:17.374686 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.374664 2563 scope.go:117] "RemoveContainer" containerID="28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139" Sep 10 21:01:17.375014 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:01:17.374985 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139\": container with ID starting with 28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139 not found: ID does not exist" containerID="28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139" Sep 10 21:01:17.375077 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.375017 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139"} err="failed to get container status \"28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139\": rpc error: code = NotFound desc = could not find container \"28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139\": container with ID starting with 28f1e81d5e9a152f1db2272f49cbf9d6afdc1532b013490cd60a4f9ba849e139 not found: ID does not exist" Sep 10 21:01:17.380687 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.380660 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f56df9fd-8mlzg"] Sep 10 21:01:17.384834 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:17.384807 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57f56df9fd-8mlzg"] Sep 10 21:01:19.329748 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:19.327309 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe952a2-beba-4149-89ff-a935e2fc1aed" path="/var/lib/kubelet/pods/cfe952a2-beba-4149-89ff-a935e2fc1aed/volumes" Sep 10 21:01:20.974989 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:20.974956 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:01:20.975246 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:20.975046 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:01:20.975246 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:20.975091 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:01:21.387977 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:21.387944 2563 generic.go:356] "Generic (PLEG): container finished" podID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerID="5da0b2e93b755bd98d9846d664b250c6d4717c3a4eef02fc0a8f0bb2e4c39269" exitCode=0 Sep 10 21:01:21.388185 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:21.388008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerDied","Data":"5da0b2e93b755bd98d9846d664b250c6d4717c3a4eef02fc0a8f0bb2e4c39269"} Sep 10 21:01:21.388185 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:21.388069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerStarted","Data":"8276c248f3621d862b652ad39145747d505796299ce7f7aae8ada6fd5d43e6b0"} Sep 10 21:01:21.388185 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:21.388091 2563 scope.go:117] "RemoveContainer" containerID="f559c03f08cddf726abcbe2fb88d9ee7d5edb8e483e795b1939ff3ebd271d1cf" Sep 10 21:01:21.857514 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:21.857478 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:01:22.858110 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:22.858065 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:22.858504 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:22.858124 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:23.857284 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:23.857241 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:23.857464 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:23.857303 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:24.857998 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:24.857960 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:24.858373 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:24.858015 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:25.858120 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:25.858077 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:25.858516 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:25.858150 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:26.857129 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:26.857092 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:26.857318 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:26.857151 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:27.857841 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:27.857800 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:27.858239 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:27.857863 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:28.857843 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:28.857800 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:28.858243 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:28.857872 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:29.858178 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:29.858133 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:29.858559 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:29.858195 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:30.858027 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:30.857989 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:30.858220 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:30.858053 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:31.858172 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:31.858132 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:31.858364 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:31.858194 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:32.212552 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.212470 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-rrwg6"] Sep 10 21:01:32.212877 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.212864 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe952a2-beba-4149-89ff-a935e2fc1aed" containerName="console" Sep 10 21:01:32.212926 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.212879 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe952a2-beba-4149-89ff-a935e2fc1aed" containerName="console" Sep 10 21:01:32.212960 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.212952 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe952a2-beba-4149-89ff-a935e2fc1aed" containerName="console" Sep 10 21:01:32.215514 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.215493 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rrwg6" Sep 10 21:01:32.218902 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.218880 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-926hb"] Sep 10 21:01:32.221162 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.221142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.222381 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.222354 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rrwg6"] Sep 10 21:01:32.223300 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.223277 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rwff8\"" Sep 10 21:01:32.223417 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.223397 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 21:01:32.232776 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.232751 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-926hb"] Sep 10 21:01:32.262426 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.262389 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-926hb"] Sep 10 21:01:32.287015 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.286982 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgpwx\" (UniqueName: \"kubernetes.io/projected/5d87899c-59dc-4f83-8b5f-9553049e959a-kube-api-access-wgpwx\") pod \"authorino-59c974bd48-rrwg6\" (UID: \"5d87899c-59dc-4f83-8b5f-9553049e959a\") " pod="kuadrant-system/authorino-59c974bd48-rrwg6" Sep 10 21:01:32.287128 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.287022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334-config-file\") pod \"limitador-limitador-84994f7ffc-926hb\" (UID: \"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.287128 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.287113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnchx\" (UniqueName: \"kubernetes.io/projected/5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334-kube-api-access-cnchx\") pod \"limitador-limitador-84994f7ffc-926hb\" (UID: \"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.388027 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.387988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgpwx\" (UniqueName: \"kubernetes.io/projected/5d87899c-59dc-4f83-8b5f-9553049e959a-kube-api-access-wgpwx\") pod \"authorino-59c974bd48-rrwg6\" (UID: \"5d87899c-59dc-4f83-8b5f-9553049e959a\") " pod="kuadrant-system/authorino-59c974bd48-rrwg6" Sep 10 21:01:32.388027 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.388029 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334-config-file\") pod \"limitador-limitador-84994f7ffc-926hb\" (UID: \"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.388206 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.388076 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnchx\" (UniqueName: \"kubernetes.io/projected/5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334-kube-api-access-cnchx\") pod \"limitador-limitador-84994f7ffc-926hb\" (UID: \"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.388747 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.388728 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334-config-file\") pod \"limitador-limitador-84994f7ffc-926hb\" (UID: \"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.396920 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.396887 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgpwx\" (UniqueName: \"kubernetes.io/projected/5d87899c-59dc-4f83-8b5f-9553049e959a-kube-api-access-wgpwx\") pod \"authorino-59c974bd48-rrwg6\" (UID: \"5d87899c-59dc-4f83-8b5f-9553049e959a\") " pod="kuadrant-system/authorino-59c974bd48-rrwg6" Sep 10 21:01:32.397060 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.396924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnchx\" (UniqueName: \"kubernetes.io/projected/5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334-kube-api-access-cnchx\") pod \"limitador-limitador-84994f7ffc-926hb\" (UID: \"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.527118 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.527085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rrwg6" Sep 10 21:01:32.534476 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.534446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:32.799473 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.799446 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rrwg6"] Sep 10 21:01:32.802187 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:01:32.802146 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d87899c_59dc_4f83_8b5f_9553049e959a.slice/crio-127d92e755e9bc4f8f36dae414b66f5bef324302209e6d2165987ab4e8ca3c68 WatchSource:0}: Error finding container 127d92e755e9bc4f8f36dae414b66f5bef324302209e6d2165987ab4e8ca3c68: Status 404 returned error can't find the container with id 127d92e755e9bc4f8f36dae414b66f5bef324302209e6d2165987ab4e8ca3c68 Sep 10 21:01:32.803960 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.803931 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-926hb"] Sep 10 21:01:32.806588 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:01:32.806536 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6aa37d_0ff3_47c5_8cd3_3a9ed289b334.slice/crio-15675f2d6ed344e715d38cac4ae872044f909532d6d6e81cce9f3121a64407aa WatchSource:0}: Error finding container 15675f2d6ed344e715d38cac4ae872044f909532d6d6e81cce9f3121a64407aa: Status 404 returned error can't find the container with id 15675f2d6ed344e715d38cac4ae872044f909532d6d6e81cce9f3121a64407aa Sep 10 21:01:32.857309 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.857267 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:32.857479 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:32.857336 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:33.445997 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:33.445961 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" event={"ID":"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334","Type":"ContainerStarted","Data":"15675f2d6ed344e715d38cac4ae872044f909532d6d6e81cce9f3121a64407aa"} Sep 10 21:01:33.447193 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:33.447165 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rrwg6" event={"ID":"5d87899c-59dc-4f83-8b5f-9553049e959a","Type":"ContainerStarted","Data":"127d92e755e9bc4f8f36dae414b66f5bef324302209e6d2165987ab4e8ca3c68"} Sep 10 21:01:33.857617 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:33.857589 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:01:33.857846 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:33.857818 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:33.857941 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:33.857880 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:34.453534 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.453499 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" event={"ID":"5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334","Type":"ContainerStarted","Data":"ed208babd564054837db83bab3990749d71ad940a0295088b3d499fee4c5030d"} Sep 10 21:01:34.454002 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.453622 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:34.455143 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.455122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rrwg6" event={"ID":"5d87899c-59dc-4f83-8b5f-9553049e959a","Type":"ContainerStarted","Data":"bb59d91a59d7152dc3c3b1c72998ac2a5e3357beccbdf01296e89c67b6792e4c"} Sep 10 21:01:34.470376 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.470195 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" podStartSLOduration=1.452438908 podStartE2EDuration="2.470171555s" totalImagesPullingTime="1.017732647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:01:34.469362201 +0000 UTC m=+413.683917488" watchObservedRunningTime="2026-09-10 21:01:34.470171555 +0000 UTC m=+413.684726843" Sep 10 21:01:34.483689 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.483639 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-rrwg6" podStartSLOduration=1.815897773 podStartE2EDuration="2.483622337s" totalImagesPullingTime="667.724564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:01:34.482492349 +0000 UTC m=+413.697047639" watchObservedRunningTime="2026-09-10 21:01:34.483622337 +0000 UTC m=+413.698177626" Sep 10 21:01:34.510284 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.510245 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-l4hk8"] Sep 10 21:01:34.510478 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.510441 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" podUID="e38f42e3-9b8f-4b10-8fca-2d72a969a918" containerName="authorino" containerID="cri-o://49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742" gracePeriod=30 Sep 10 21:01:34.748575 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.748543 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" Sep 10 21:01:34.857318 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.857274 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:34.857519 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.857336 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:34.911777 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.911740 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4vgr\" (UniqueName: \"kubernetes.io/projected/e38f42e3-9b8f-4b10-8fca-2d72a969a918-kube-api-access-t4vgr\") pod \"e38f42e3-9b8f-4b10-8fca-2d72a969a918\" (UID: \"e38f42e3-9b8f-4b10-8fca-2d72a969a918\") " Sep 10 21:01:34.913996 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:34.913965 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38f42e3-9b8f-4b10-8fca-2d72a969a918-kube-api-access-t4vgr" (OuterVolumeSpecName: "kube-api-access-t4vgr") pod "e38f42e3-9b8f-4b10-8fca-2d72a969a918" (UID: "e38f42e3-9b8f-4b10-8fca-2d72a969a918"). InnerVolumeSpecName "kube-api-access-t4vgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 21:01:35.013411 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.013315 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4vgr\" (UniqueName: \"kubernetes.io/projected/e38f42e3-9b8f-4b10-8fca-2d72a969a918-kube-api-access-t4vgr\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:01:35.461161 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.461127 2563 generic.go:356] "Generic (PLEG): container finished" podID="e38f42e3-9b8f-4b10-8fca-2d72a969a918" containerID="49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742" exitCode=0 Sep 10 21:01:35.461630 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.461169 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" Sep 10 21:01:35.461630 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.461219 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" event={"ID":"e38f42e3-9b8f-4b10-8fca-2d72a969a918","Type":"ContainerDied","Data":"49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742"} Sep 10 21:01:35.461630 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.461264 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-l4hk8" event={"ID":"e38f42e3-9b8f-4b10-8fca-2d72a969a918","Type":"ContainerDied","Data":"32396ebad105a747290e208ac32d51279d23e20828ca4f53afaffe122a6b17d7"} Sep 10 21:01:35.461630 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.461287 2563 scope.go:117] "RemoveContainer" containerID="49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742" Sep 10 21:01:35.469501 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.469486 2563 scope.go:117] "RemoveContainer" containerID="49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742" Sep 10 21:01:35.469785 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:01:35.469768 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742\": container with ID starting with 49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742 not found: ID does not exist" containerID="49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742" Sep 10 21:01:35.469841 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.469794 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742"} err="failed to get container status \"49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742\": rpc error: code = NotFound desc = could not find container \"49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742\": container with ID starting with 49fb8c8316ede4112c4587e5a59067b8d191d243e2f0460998f04376dfb2c742 not found: ID does not exist" Sep 10 21:01:35.475698 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.475676 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-l4hk8"] Sep 10 21:01:35.479601 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.479578 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-l4hk8"] Sep 10 21:01:35.857823 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.857783 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:35.858047 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:35.857843 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:36.858097 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:36.858054 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:36.858480 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:36.858117 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:37.326273 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:37.326239 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e38f42e3-9b8f-4b10-8fca-2d72a969a918" path="/var/lib/kubelet/pods/e38f42e3-9b8f-4b10-8fca-2d72a969a918/volumes" Sep 10 21:01:37.857958 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:37.857911 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:37.858144 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:37.857976 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:38.857825 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:38.857775 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:38.858039 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:38.857844 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:39.857468 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:39.857429 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:39.857866 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:39.857489 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:40.857410 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:40.857376 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:40.857604 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:40.857431 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:41.857475 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:41.857435 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:41.857681 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:41.857490 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:42.857803 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:42.857760 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:42.858160 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:42.857820 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:43.857987 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:43.857950 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:43.858374 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:43.858008 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:44.858205 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:44.858167 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:44.858687 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:44.858232 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:45.462471 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:45.462440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-926hb" Sep 10 21:01:45.858018 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:45.857979 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:45.858217 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:45.858064 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:46.858006 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:46.857965 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:46.858415 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:46.858024 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:47.857309 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:47.857266 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:47.857469 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:47.857341 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:48.857376 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:48.857335 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:48.857778 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:48.857399 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:49.857649 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:49.857610 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:49.858057 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:49.857682 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:50.857195 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:50.857151 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:50.857383 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:50.857219 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:51.857208 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:51.857159 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:51.857665 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:51.857253 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:51.857665 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:51.857310 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:01:51.857987 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:51.857964 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="istio-proxy" containerStatusID={"Type":"cri-o","ID":"8276c248f3621d862b652ad39145747d505796299ce7f7aae8ada6fd5d43e6b0"} pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" containerMessage="Container istio-proxy failed startup probe, will be restarted" Sep 10 21:01:51.858036 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:51.858016 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" containerID="cri-o://8276c248f3621d862b652ad39145747d505796299ce7f7aae8ada6fd5d43e6b0" gracePeriod=30 Sep 10 21:01:56.970107 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:56.970068 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:01:56.970428 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:56.970148 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:01:56.970428 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:56.970206 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:01:57.565660 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:57.565627 2563 generic.go:356] "Generic (PLEG): container finished" podID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerID="8276c248f3621d862b652ad39145747d505796299ce7f7aae8ada6fd5d43e6b0" exitCode=0 Sep 10 21:01:57.565846 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:57.565701 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerDied","Data":"8276c248f3621d862b652ad39145747d505796299ce7f7aae8ada6fd5d43e6b0"} Sep 10 21:01:57.565846 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:57.565762 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerStarted","Data":"8ea65ff5e5ad7629d7267d0d8109d24ab5ab43d9cd042907fcfac51d29b45954"} Sep 10 21:01:57.565846 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:57.565785 2563 scope.go:117] "RemoveContainer" containerID="5da0b2e93b755bd98d9846d664b250c6d4717c3a4eef02fc0a8f0bb2e4c39269" Sep 10 21:01:57.857973 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:57.857865 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:01:58.857511 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:58.857471 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:58.857929 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:58.857537 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:01:59.858067 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:59.858025 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:01:59.858452 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:01:59.858100 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:00.857449 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:00.857411 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:00.857661 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:00.857470 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:01.857692 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:01.857648 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:01.858158 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:01.857713 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:02.858203 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:02.858158 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:02.858619 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:02.858226 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:03.857451 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:03.857414 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:02:03.857692 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:03.857670 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:03.857746 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:03.857719 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:04.857279 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:04.857247 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:04.857655 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:04.857304 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:05.857942 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:05.857904 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:05.858325 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:05.857963 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:06.857328 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:06.857289 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:06.857513 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:06.857346 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:07.857396 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:07.857356 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:07.857811 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:07.857421 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:08.857679 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:08.857631 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:08.858063 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:08.857709 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:09.858013 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:09.857967 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:09.858402 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:09.858043 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:10.857877 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:10.857826 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:10.858063 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:10.857900 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:11.857536 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:11.857493 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:11.857758 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:11.857597 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:12.858099 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:12.858057 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:12.858481 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:12.858115 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:13.857856 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:13.857812 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:13.858049 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:13.857877 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:14.857842 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:14.857803 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:14.858251 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:14.857871 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:15.857366 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:15.857320 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:15.857549 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:15.857385 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:16.857737 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:16.857700 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:16.858154 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:16.857772 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:17.857895 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:17.857856 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:17.858275 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:17.857916 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:18.857877 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:18.857833 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:18.858053 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:18.857898 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:19.857548 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:19.857509 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:19.857761 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:19.857592 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:20.857952 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:20.857915 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:20.858401 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:20.857989 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:21.646682 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.646648 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl"] Sep 10 21:02:21.647044 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.647033 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38f42e3-9b8f-4b10-8fca-2d72a969a918" containerName="authorino" Sep 10 21:02:21.647092 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.647046 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38f42e3-9b8f-4b10-8fca-2d72a969a918" containerName="authorino" Sep 10 21:02:21.647131 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.647117 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38f42e3-9b8f-4b10-8fca-2d72a969a918" containerName="authorino" Sep 10 21:02:21.649519 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.649504 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.651842 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.651810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 21:02:21.651842 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.651839 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 21:02:21.652015 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.651919 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 21:02:21.652053 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.652031 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nnw2v\"" Sep 10 21:02:21.652101 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.652048 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 21:02:21.669401 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.669372 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl"] Sep 10 21:02:21.738550 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.738518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.738781 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.738590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-manifests\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.738781 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.738679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.738781 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.738720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llln6\" (UniqueName: \"kubernetes.io/projected/eb009e8d-f720-4276-856c-781d0b462447-kube-api-access-llln6\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.738889 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.738808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-tmp\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.839922 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.839882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-tmp\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.840100 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.839934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.840100 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.839982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-manifests\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.840100 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.840016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.840100 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.840043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llln6\" (UniqueName: \"kubernetes.io/projected/eb009e8d-f720-4276-856c-781d0b462447-kube-api-access-llln6\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.840445 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.840424 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-manifests\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.842251 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.842218 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-tmp\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.842461 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.842439 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.842585 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.842551 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.848086 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.848060 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llln6\" (UniqueName: \"kubernetes.io/projected/eb009e8d-f720-4276-856c-781d0b462447-kube-api-access-llln6\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:21.857720 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.857695 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:21.857837 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.857746 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:21.959590 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:21.959460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:22.254720 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:22.254693 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl"] Sep 10 21:02:22.257392 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:02:22.257363 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb009e8d_f720_4276_856c_781d0b462447.slice/crio-5ae2d9d348dd214cd503ba8400ff2205d6e67bf90546415ff55b98f4337a5732 WatchSource:0}: Error finding container 5ae2d9d348dd214cd503ba8400ff2205d6e67bf90546415ff55b98f4337a5732: Status 404 returned error can't find the container with id 5ae2d9d348dd214cd503ba8400ff2205d6e67bf90546415ff55b98f4337a5732 Sep 10 21:02:22.688270 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:22.688178 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" event={"ID":"eb009e8d-f720-4276-856c-781d0b462447","Type":"ContainerStarted","Data":"5ae2d9d348dd214cd503ba8400ff2205d6e67bf90546415ff55b98f4337a5732"} Sep 10 21:02:22.857393 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:22.857336 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:22.857624 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:22.857409 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:23.858041 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:23.857999 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:23.858499 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:23.858072 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:24.857661 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:24.857628 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:24.857864 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:24.857691 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:25.706056 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:25.706009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" event={"ID":"eb009e8d-f720-4276-856c-781d0b462447","Type":"ContainerStarted","Data":"921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0"} Sep 10 21:02:25.857971 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:25.857926 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:25.858138 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:25.858010 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:26.711911 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:26.711809 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb009e8d-f720-4276-856c-781d0b462447" containerID="921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0" exitCode=0 Sep 10 21:02:26.711911 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:26.711867 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" event={"ID":"eb009e8d-f720-4276-856c-781d0b462447","Type":"ContainerDied","Data":"921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0"} Sep 10 21:02:26.857362 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:26.857316 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:26.857593 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:26.857392 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:27.718919 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.718826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" event={"ID":"eb009e8d-f720-4276-856c-781d0b462447","Type":"ContainerStarted","Data":"72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210"} Sep 10 21:02:27.719353 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.718946 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:27.739984 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.739936 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" podStartSLOduration=2.30414954 podStartE2EDuration="6.739921078s" totalImagesPullingTime="3.309315595s" totalInitContainerRuntime="1.126455943s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:27.739236401 +0000 UTC m=+466.953791701" watchObservedRunningTime="2026-09-10 21:02:27.739921078 +0000 UTC m=+466.954476396" Sep 10 21:02:27.857542 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.857500 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:27.857878 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.857598 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:27.857878 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.857656 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:02:27.858242 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.858219 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="istio-proxy" containerStatusID={"Type":"cri-o","ID":"8ea65ff5e5ad7629d7267d0d8109d24ab5ab43d9cd042907fcfac51d29b45954"} pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" containerMessage="Container istio-proxy failed startup probe, will be restarted" Sep 10 21:02:27.858325 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:27.858266 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" containerID="cri-o://8ea65ff5e5ad7629d7267d0d8109d24ab5ab43d9cd042907fcfac51d29b45954" gracePeriod=30 Sep 10 21:02:32.976532 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:32.976496 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:02:32.976861 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:32.976589 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:02:32.976861 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:32.976636 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:02:33.751081 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:33.751051 2563 generic.go:356] "Generic (PLEG): container finished" podID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerID="8ea65ff5e5ad7629d7267d0d8109d24ab5ab43d9cd042907fcfac51d29b45954" exitCode=0 Sep 10 21:02:33.751255 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:33.751132 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerDied","Data":"8ea65ff5e5ad7629d7267d0d8109d24ab5ab43d9cd042907fcfac51d29b45954"} Sep 10 21:02:33.751255 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:33.751191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerStarted","Data":"e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042"} Sep 10 21:02:33.751255 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:33.751214 2563 scope.go:117] "RemoveContainer" containerID="8276c248f3621d862b652ad39145747d505796299ce7f7aae8ada6fd5d43e6b0" Sep 10 21:02:33.856822 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:33.856795 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:02:33.856978 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:33.856847 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:02:34.857431 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:34.857391 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:34.857826 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:34.857447 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:35.857367 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:35.857326 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:35.857612 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:35.857392 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:36.857319 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:36.857281 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:36.857500 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:36.857340 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:37.857328 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:37.857286 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:37.857739 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:37.857345 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:38.725892 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:38.725857 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:38.858008 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:38.857963 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:38.858461 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:38.858036 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:39.857837 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:39.857791 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:39.858021 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:39.857862 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:40.301319 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.301284 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl"] Sep 10 21:02:40.301735 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.301493 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" podUID="eb009e8d-f720-4276-856c-781d0b462447" containerName="manager" containerID="cri-o://72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210" gracePeriod=2 Sep 10 21:02:40.312936 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.312903 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl"] Sep 10 21:02:40.317637 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:40.317596 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"eb009e8d-f720-4276-856c-781d0b462447\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"opendatahub\"/\"opendatahub-operator-controller-manager-7c54d7bd98-684tl\": pods \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" not found" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:40.338089 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.336182 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd"] Sep 10 21:02:40.338089 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.336786 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb009e8d-f720-4276-856c-781d0b462447" containerName="manager" Sep 10 21:02:40.338089 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.336806 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb009e8d-f720-4276-856c-781d0b462447" containerName="manager" Sep 10 21:02:40.338089 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.336826 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb009e8d-f720-4276-856c-781d0b462447" containerName="copy-manifests" Sep 10 21:02:40.338089 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.336835 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb009e8d-f720-4276-856c-781d0b462447" containerName="copy-manifests" Sep 10 21:02:40.338089 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.336921 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb009e8d-f720-4276-856c-781d0b462447" containerName="manager" Sep 10 21:02:40.341552 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.341095 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.345437 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:40.345403 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="eb009e8d-f720-4276-856c-781d0b462447" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:40.360924 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.360892 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd"] Sep 10 21:02:40.418087 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.418054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-manifests\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.418235 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.418096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-tmp\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.418235 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.418153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8d8b\" (UniqueName: \"kubernetes.io/projected/ef9dcd20-b9ab-45f4-b443-ec342590dc94-kube-api-access-r8d8b\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.418363 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.418339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.418404 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.418379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.519252 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.519209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-manifests\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.519252 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.519249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-tmp\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.519510 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.519282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8d8b\" (UniqueName: \"kubernetes.io/projected/ef9dcd20-b9ab-45f4-b443-ec342590dc94-kube-api-access-r8d8b\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.519510 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.519338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.519510 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.519358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.519703 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.519666 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-manifests\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.521528 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.521502 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-tmp\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.521831 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.521811 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.521979 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.521959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.535285 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.535253 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8d8b\" (UniqueName: \"kubernetes.io/projected/ef9dcd20-b9ab-45f4-b443-ec342590dc94-kube-api-access-r8d8b\") pod \"opendatahub-operator-controller-manager-7c54d7bd98-j2gcd\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.553965 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.553892 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:40.556397 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:40.556356 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="eb009e8d-f720-4276-856c-781d0b462447" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:40.620555 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.620517 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-tmp\") pod \"eb009e8d-f720-4276-856c-781d0b462447\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " Sep 10 21:02:40.620773 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.620633 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-manifests\") pod \"eb009e8d-f720-4276-856c-781d0b462447\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " Sep 10 21:02:40.620773 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.620656 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llln6\" (UniqueName: \"kubernetes.io/projected/eb009e8d-f720-4276-856c-781d0b462447-kube-api-access-llln6\") pod \"eb009e8d-f720-4276-856c-781d0b462447\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " Sep 10 21:02:40.620773 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.620676 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-apiservice-cert\") pod \"eb009e8d-f720-4276-856c-781d0b462447\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " Sep 10 21:02:40.620773 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.620718 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-webhook-cert\") pod \"eb009e8d-f720-4276-856c-781d0b462447\" (UID: \"eb009e8d-f720-4276-856c-781d0b462447\") " Sep 10 21:02:40.623112 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.623067 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-tmp" (OuterVolumeSpecName: "tmp") pod "eb009e8d-f720-4276-856c-781d0b462447" (UID: "eb009e8d-f720-4276-856c-781d0b462447"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 21:02:40.623249 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.623127 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eb009e8d-f720-4276-856c-781d0b462447" (UID: "eb009e8d-f720-4276-856c-781d0b462447"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 21:02:40.623249 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.623191 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb009e8d-f720-4276-856c-781d0b462447-kube-api-access-llln6" (OuterVolumeSpecName: "kube-api-access-llln6") pod "eb009e8d-f720-4276-856c-781d0b462447" (UID: "eb009e8d-f720-4276-856c-781d0b462447"). InnerVolumeSpecName "kube-api-access-llln6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 21:02:40.623249 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.623232 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "eb009e8d-f720-4276-856c-781d0b462447" (UID: "eb009e8d-f720-4276-856c-781d0b462447"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 21:02:40.664517 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.664475 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-manifests" (OuterVolumeSpecName: "manifests") pod "eb009e8d-f720-4276-856c-781d0b462447" (UID: "eb009e8d-f720-4276-856c-781d0b462447"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 21:02:40.684983 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.684946 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:40.722212 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.722168 2563 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-tmp\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:40.722212 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.722198 2563 reconciler_common.go:299] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb009e8d-f720-4276-856c-781d0b462447-manifests\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:40.722212 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.722210 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llln6\" (UniqueName: \"kubernetes.io/projected/eb009e8d-f720-4276-856c-781d0b462447-kube-api-access-llln6\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:40.722212 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.722220 2563 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-apiservice-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:40.722212 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.722228 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb009e8d-f720-4276-856c-781d0b462447-webhook-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:40.787610 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.787553 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb009e8d-f720-4276-856c-781d0b462447" containerID="72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210" exitCode=0 Sep 10 21:02:40.787804 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.787624 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:40.787804 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.787632 2563 scope.go:117] "RemoveContainer" containerID="72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210" Sep 10 21:02:40.790011 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:40.789979 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="eb009e8d-f720-4276-856c-781d0b462447" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:40.796254 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.796232 2563 scope.go:117] "RemoveContainer" containerID="921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0" Sep 10 21:02:40.797976 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:40.797948 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="eb009e8d-f720-4276-856c-781d0b462447" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:40.804157 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.804140 2563 scope.go:117] "RemoveContainer" containerID="72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210" Sep 10 21:02:40.804458 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:40.804438 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210\": container with ID starting with 72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210 not found: ID does not exist" containerID="72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210" Sep 10 21:02:40.804501 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.804470 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210"} err="failed to get container status \"72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210\": rpc error: code = NotFound desc = could not find container \"72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210\": container with ID starting with 72f784ad7648577b501223bacdef974261c0e4885cb874035699dcf0018f1210 not found: ID does not exist" Sep 10 21:02:40.804501 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.804487 2563 scope.go:117] "RemoveContainer" containerID="921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0" Sep 10 21:02:40.804781 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:40.804763 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0\": container with ID starting with 921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0 not found: ID does not exist" containerID="921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0" Sep 10 21:02:40.804848 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.804788 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0"} err="failed to get container status \"921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0\": rpc error: code = NotFound desc = could not find container \"921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0\": container with ID starting with 921dc9787ad8377334035079e8a0fa4adaef6f9469f071de407a1784a58e71c0 not found: ID does not exist" Sep 10 21:02:40.857498 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.857462 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:40.857658 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.857515 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:40.972432 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:40.972318 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd"] Sep 10 21:02:40.975022 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:02:40.974997 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9dcd20_b9ab_45f4_b443_ec342590dc94.slice/crio-edd81cd643dd9b9b2b1f56a2a5503f362e43f5e3868a760b76692a4adf51e436 WatchSource:0}: Error finding container edd81cd643dd9b9b2b1f56a2a5503f362e43f5e3868a760b76692a4adf51e436: Status 404 returned error can't find the container with id edd81cd643dd9b9b2b1f56a2a5503f362e43f5e3868a760b76692a4adf51e436 Sep 10 21:02:41.325985 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:41.325948 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-7c54d7bd98-684tl\" is forbidden: User \"system:node:ip-10-0-142-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-97.ec2.internal' and this object" podUID="eb009e8d-f720-4276-856c-781d0b462447" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-684tl" Sep 10 21:02:41.327810 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:41.327782 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb009e8d-f720-4276-856c-781d0b462447" path="/var/lib/kubelet/pods/eb009e8d-f720-4276-856c-781d0b462447/volumes" Sep 10 21:02:41.794920 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:41.794878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" event={"ID":"ef9dcd20-b9ab-45f4-b443-ec342590dc94","Type":"ContainerStarted","Data":"767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e"} Sep 10 21:02:41.795271 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:41.795248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" event={"ID":"ef9dcd20-b9ab-45f4-b443-ec342590dc94","Type":"ContainerStarted","Data":"edd81cd643dd9b9b2b1f56a2a5503f362e43f5e3868a760b76692a4adf51e436"} Sep 10 21:02:41.858094 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:41.858056 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:41.858262 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:41.858118 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:42.232965 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.232930 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr"] Sep 10 21:02:42.241165 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.241141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.252825 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.252799 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr"] Sep 10 21:02:42.335167 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.335128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a23960b-0c34-46bf-8286-3246622ea29b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.335649 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.335184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a23960b-0c34-46bf-8286-3246622ea29b-manifests\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.335649 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.335283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a23960b-0c34-46bf-8286-3246622ea29b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.335649 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.335382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwkg\" (UniqueName: \"kubernetes.io/projected/2a23960b-0c34-46bf-8286-3246622ea29b-kube-api-access-2lwkg\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.335649 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.335439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a23960b-0c34-46bf-8286-3246622ea29b-tmp\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.436287 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.436250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a23960b-0c34-46bf-8286-3246622ea29b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.436463 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.436315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwkg\" (UniqueName: \"kubernetes.io/projected/2a23960b-0c34-46bf-8286-3246622ea29b-kube-api-access-2lwkg\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.436463 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.436341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a23960b-0c34-46bf-8286-3246622ea29b-tmp\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.436463 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.436366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a23960b-0c34-46bf-8286-3246622ea29b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.436463 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.436405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a23960b-0c34-46bf-8286-3246622ea29b-manifests\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.436811 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.436780 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a23960b-0c34-46bf-8286-3246622ea29b-manifests\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.438775 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.438746 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a23960b-0c34-46bf-8286-3246622ea29b-tmp\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.438953 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.438927 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a23960b-0c34-46bf-8286-3246622ea29b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.439068 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.439047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a23960b-0c34-46bf-8286-3246622ea29b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.446157 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.446130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwkg\" (UniqueName: \"kubernetes.io/projected/2a23960b-0c34-46bf-8286-3246622ea29b-kube-api-access-2lwkg\") pod \"opendatahub-operator-controller-manager-7d44794c8d-q2mqr\" (UID: \"2a23960b-0c34-46bf-8286-3246622ea29b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.551677 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.551588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:42.800926 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.800891 2563 generic.go:356] "Generic (PLEG): container finished" podID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerID="767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e" exitCode=0 Sep 10 21:02:42.801096 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.800976 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" event={"ID":"ef9dcd20-b9ab-45f4-b443-ec342590dc94","Type":"ContainerDied","Data":"767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e"} Sep 10 21:02:42.831126 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.831105 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr"] Sep 10 21:02:42.836465 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:02:42.836427 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a23960b_0c34_46bf_8286_3246622ea29b.slice/crio-01366b1ecfa683eabe2bacb0d76432a364683deb247be786624d7256eba9125d WatchSource:0}: Error finding container 01366b1ecfa683eabe2bacb0d76432a364683deb247be786624d7256eba9125d: Status 404 returned error can't find the container with id 01366b1ecfa683eabe2bacb0d76432a364683deb247be786624d7256eba9125d Sep 10 21:02:42.857892 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.857854 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:42.858054 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:42.857912 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:43.807329 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:43.807292 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" event={"ID":"ef9dcd20-b9ab-45f4-b443-ec342590dc94","Type":"ContainerStarted","Data":"d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a"} Sep 10 21:02:43.807873 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:43.807407 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:43.808976 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:43.808950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" event={"ID":"2a23960b-0c34-46bf-8286-3246622ea29b","Type":"ContainerStarted","Data":"ebb1fed647451ac7d50cf579b20286e41a2af629778087af6c499c795d2efdd4"} Sep 10 21:02:43.809087 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:43.808987 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" event={"ID":"2a23960b-0c34-46bf-8286-3246622ea29b","Type":"ContainerStarted","Data":"01366b1ecfa683eabe2bacb0d76432a364683deb247be786624d7256eba9125d"} Sep 10 21:02:43.857544 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:43.857510 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:43.857723 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:43.857589 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:43.861724 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:43.861678 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" podStartSLOduration=2.008468426 podStartE2EDuration="3.861656368s" totalImagesPullingTime="822.612422ms" totalInitContainerRuntime="1.03057552s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:43.860588009 +0000 UTC m=+483.075143297" watchObservedRunningTime="2026-09-10 21:02:43.861656368 +0000 UTC m=+483.076211657" Sep 10 21:02:44.816255 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:44.816217 2563 generic.go:356] "Generic (PLEG): container finished" podID="2a23960b-0c34-46bf-8286-3246622ea29b" containerID="ebb1fed647451ac7d50cf579b20286e41a2af629778087af6c499c795d2efdd4" exitCode=0 Sep 10 21:02:44.816765 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:44.816301 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" event={"ID":"2a23960b-0c34-46bf-8286-3246622ea29b","Type":"ContainerDied","Data":"ebb1fed647451ac7d50cf579b20286e41a2af629778087af6c499c795d2efdd4"} Sep 10 21:02:44.857600 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:44.857546 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:44.857750 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:44.857616 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:45.824133 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:45.824098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" event={"ID":"2a23960b-0c34-46bf-8286-3246622ea29b","Type":"ContainerStarted","Data":"5ca72e63b3b072d81ff47c99a0b3746a929e5b28cc40eccefbd1f352b5731a61"} Sep 10 21:02:45.824594 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:45.824236 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:45.846634 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:45.846580 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" podStartSLOduration=1.8660240799999999 podStartE2EDuration="3.846543342s" totalImagesPullingTime="962.161185ms" totalInitContainerRuntime="1.018358077s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:45.845361001 +0000 UTC m=+485.059916289" watchObservedRunningTime="2026-09-10 21:02:45.846543342 +0000 UTC m=+485.061098630" Sep 10 21:02:45.857289 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:45.857254 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:45.857447 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:45.857303 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:46.858035 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:46.857991 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:46.858431 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:46.858054 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:47.857554 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:47.857505 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:47.857768 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:47.857600 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:48.857365 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:48.857325 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:48.857779 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:48.857393 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:49.857767 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:49.857731 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:49.858163 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:49.857794 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:50.857685 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:50.857646 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:50.857916 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:50.857712 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:51.859644 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:51.859601 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:51.860108 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:51.859680 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:52.857524 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:52.857480 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:52.857721 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:52.857543 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:53.857762 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:53.857726 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:53.858160 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:53.857783 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:54.819103 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:54.819073 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:54.857700 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:54.857662 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:54.857901 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:54.857733 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:55.857364 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:55.857326 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:55.857545 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:55.857400 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:56.296277 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:56.296240 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59c974bd48-rrwg6_5d87899c-59dc-4f83-8b5f-9553049e959a/authorino/0.log" Sep 10 21:02:56.830902 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:56.830859 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d44794c8d-q2mqr" Sep 10 21:02:56.857955 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:56.857923 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:56.858139 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:56.857979 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:56.883680 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:56.883637 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd"] Sep 10 21:02:56.883892 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:56.883858 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" podUID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerName="manager" containerID="cri-o://d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a" gracePeriod=10 Sep 10 21:02:57.125542 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.125517 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:57.277242 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.277202 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-manifests\") pod \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " Sep 10 21:02:57.277242 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.277240 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-tmp\") pod \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " Sep 10 21:02:57.277504 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.277295 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-apiservice-cert\") pod \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " Sep 10 21:02:57.277504 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.277408 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8d8b\" (UniqueName: \"kubernetes.io/projected/ef9dcd20-b9ab-45f4-b443-ec342590dc94-kube-api-access-r8d8b\") pod \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " Sep 10 21:02:57.277504 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.277442 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-webhook-cert\") pod \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\" (UID: \"ef9dcd20-b9ab-45f4-b443-ec342590dc94\") " Sep 10 21:02:57.279494 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.279460 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-tmp" (OuterVolumeSpecName: "tmp") pod "ef9dcd20-b9ab-45f4-b443-ec342590dc94" (UID: "ef9dcd20-b9ab-45f4-b443-ec342590dc94"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 21:02:57.280131 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.280102 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "ef9dcd20-b9ab-45f4-b443-ec342590dc94" (UID: "ef9dcd20-b9ab-45f4-b443-ec342590dc94"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 21:02:57.280131 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.280118 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef9dcd20-b9ab-45f4-b443-ec342590dc94-kube-api-access-r8d8b" (OuterVolumeSpecName: "kube-api-access-r8d8b") pod "ef9dcd20-b9ab-45f4-b443-ec342590dc94" (UID: "ef9dcd20-b9ab-45f4-b443-ec342590dc94"). InnerVolumeSpecName "kube-api-access-r8d8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 21:02:57.280131 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.280116 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ef9dcd20-b9ab-45f4-b443-ec342590dc94" (UID: "ef9dcd20-b9ab-45f4-b443-ec342590dc94"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 21:02:57.321731 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.321685 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-manifests" (OuterVolumeSpecName: "manifests") pod "ef9dcd20-b9ab-45f4-b443-ec342590dc94" (UID: "ef9dcd20-b9ab-45f4-b443-ec342590dc94"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 21:02:57.378434 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.378346 2563 reconciler_common.go:299] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-manifests\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:57.378434 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.378378 2563 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef9dcd20-b9ab-45f4-b443-ec342590dc94-tmp\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:57.378434 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.378387 2563 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-apiservice-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:57.378434 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.378418 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8d8b\" (UniqueName: \"kubernetes.io/projected/ef9dcd20-b9ab-45f4-b443-ec342590dc94-kube-api-access-r8d8b\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:57.378434 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.378428 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef9dcd20-b9ab-45f4-b443-ec342590dc94-webhook-cert\") on node \"ip-10-0-142-97.ec2.internal\" DevicePath \"\"" Sep 10 21:02:57.857392 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.857351 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:57.857600 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.857425 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:57.895405 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.895369 2563 generic.go:356] "Generic (PLEG): container finished" podID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerID="d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a" exitCode=0 Sep 10 21:02:57.895541 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.895435 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" Sep 10 21:02:57.895541 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.895445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" event={"ID":"ef9dcd20-b9ab-45f4-b443-ec342590dc94","Type":"ContainerDied","Data":"d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a"} Sep 10 21:02:57.895541 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.895494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd" event={"ID":"ef9dcd20-b9ab-45f4-b443-ec342590dc94","Type":"ContainerDied","Data":"edd81cd643dd9b9b2b1f56a2a5503f362e43f5e3868a760b76692a4adf51e436"} Sep 10 21:02:57.895541 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.895518 2563 scope.go:117] "RemoveContainer" containerID="d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a" Sep 10 21:02:57.904175 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.904156 2563 scope.go:117] "RemoveContainer" containerID="767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e" Sep 10 21:02:57.912069 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.912045 2563 scope.go:117] "RemoveContainer" containerID="d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a" Sep 10 21:02:57.912343 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:57.912323 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a\": container with ID starting with d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a not found: ID does not exist" containerID="d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a" Sep 10 21:02:57.912417 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.912356 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a"} err="failed to get container status \"d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a\": rpc error: code = NotFound desc = could not find container \"d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a\": container with ID starting with d6abffd0ae47096de6fe715fa38f72918cf9a18bdc3607fc2bbc8a3a0514356a not found: ID does not exist" Sep 10 21:02:57.912417 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.912384 2563 scope.go:117] "RemoveContainer" containerID="767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e" Sep 10 21:02:57.912686 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:02:57.912668 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e\": container with ID starting with 767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e not found: ID does not exist" containerID="767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e" Sep 10 21:02:57.912725 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.912696 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e"} err="failed to get container status \"767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e\": rpc error: code = NotFound desc = could not find container \"767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e\": container with ID starting with 767128e992e0cea6aef5654dafb2cfd24f12160b24a5ec95c1aec7a9556d2d6e not found: ID does not exist" Sep 10 21:02:57.915369 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.915346 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd"] Sep 10 21:02:57.919507 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:57.919487 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c54d7bd98-j2gcd"] Sep 10 21:02:58.858181 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:58.858143 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:58.858598 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:58.858213 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:02:59.326146 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:59.326101 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" path="/var/lib/kubelet/pods/ef9dcd20-b9ab-45f4-b443-ec342590dc94/volumes" Sep 10 21:02:59.857875 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:59.857828 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:02:59.858063 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:02:59.857909 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:03:00.857203 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:00.857169 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:03:00.857593 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:00.857233 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:03:01.048748 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.048713 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6"] Sep 10 21:03:01.049132 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.049118 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerName="manager" Sep 10 21:03:01.049191 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.049134 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerName="manager" Sep 10 21:03:01.049191 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.049153 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerName="copy-manifests" Sep 10 21:03:01.049191 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.049159 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerName="copy-manifests" Sep 10 21:03:01.049290 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.049237 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef9dcd20-b9ab-45f4-b443-ec342590dc94" containerName="manager" Sep 10 21:03:01.059488 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.059464 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.062286 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.062262 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5jmpp\"" Sep 10 21:03:01.070661 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.070636 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6"] Sep 10 21:03:01.214097 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214097 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214320 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214320 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214320 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214320 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214529 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214529 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.214529 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.214363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47zpc\" (UniqueName: \"kubernetes.io/projected/fbf1d1a0-f350-4509-97f7-1445bf3965a6-kube-api-access-47zpc\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315371 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315599 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315599 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315599 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315599 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315852 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315852 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315852 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.315852 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47zpc\" (UniqueName: \"kubernetes.io/projected/fbf1d1a0-f350-4509-97f7-1445bf3965a6-kube-api-access-47zpc\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.316069 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315870 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.316069 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.315992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.316069 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.316049 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.316286 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.316265 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.316643 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.316619 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.317841 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.317818 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.318051 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.318029 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.323687 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.323665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47zpc\" (UniqueName: \"kubernetes.io/projected/fbf1d1a0-f350-4509-97f7-1445bf3965a6-kube-api-access-47zpc\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.323772 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.323693 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbf1d1a0-f350-4509-97f7-1445bf3965a6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cz82q6\" (UID: \"fbf1d1a0-f350-4509-97f7-1445bf3965a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.371125 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.371092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:01.649929 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.649899 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6"] Sep 10 21:03:01.652754 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:03:01.652719 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf1d1a0_f350_4509_97f7_1445bf3965a6.slice/crio-688240cecb502362ea5a02268d5c8e06a5a7f4ec9326fae3d22f76084028aca4 WatchSource:0}: Error finding container 688240cecb502362ea5a02268d5c8e06a5a7f4ec9326fae3d22f76084028aca4: Status 404 returned error can't find the container with id 688240cecb502362ea5a02268d5c8e06a5a7f4ec9326fae3d22f76084028aca4 Sep 10 21:03:01.654872 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.654836 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:03:01.654992 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.654916 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:03:01.654992 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.654949 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 10 21:03:01.678875 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.678853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d44794c8d-q2mqr_2a23960b-0c34-46bf-8286-3246622ea29b/copy-manifests/0.log" Sep 10 21:03:01.685358 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.685331 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d44794c8d-q2mqr_2a23960b-0c34-46bf-8286-3246622ea29b/manager/0.log" Sep 10 21:03:01.857774 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.857737 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:03:01.858247 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.857792 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:03:01.917695 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.917587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" event={"ID":"fbf1d1a0-f350-4509-97f7-1445bf3965a6","Type":"ContainerStarted","Data":"cf98ea35c549d010ac61c43331ba73d1ebe9c1002bd4555d0a8e847d9d89219c"} Sep 10 21:03:01.917695 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.917664 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" event={"ID":"fbf1d1a0-f350-4509-97f7-1445bf3965a6","Type":"ContainerStarted","Data":"688240cecb502362ea5a02268d5c8e06a5a7f4ec9326fae3d22f76084028aca4"} Sep 10 21:03:01.938366 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:01.938302 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" podStartSLOduration=0.938284931 podStartE2EDuration="938.284931ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:01.936397524 +0000 UTC m=+501.150952814" watchObservedRunningTime="2026-09-10 21:03:01.938284931 +0000 UTC m=+501.152840218" Sep 10 21:03:02.372163 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.372123 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:02.376736 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.376710 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:02.430299 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.430270 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59c974bd48-rrwg6_5d87899c-59dc-4f83-8b5f-9553049e959a/authorino/0.log" Sep 10 21:03:02.858189 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.858148 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:03:02.858592 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.858216 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:03:02.922048 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.922008 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:02.923108 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.923084 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz82q6" Sep 10 21:03:02.992518 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:02.992492 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-926hb_5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334/limitador/0.log" Sep 10 21:03:03.432048 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:03.432012 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cz82q6_fbf1d1a0-f350-4509-97f7-1445bf3965a6/istio-proxy/0.log" Sep 10 21:03:03.858144 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:03.858105 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-hlwbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Sep 10 21:03:03.858297 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:03.858167 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Sep 10 21:03:03.858297 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:03.858208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" Sep 10 21:03:03.858785 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:03.858766 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="istio-proxy" containerStatusID={"Type":"cri-o","ID":"e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042"} pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" containerMessage="Container istio-proxy failed startup probe, will be restarted" Sep 10 21:03:03.858826 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:03.858809 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerName="istio-proxy" containerID="cri-o://e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042" gracePeriod=30 Sep 10 21:03:03.875742 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:03.875717 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-697c686cf6-hlwbq_5b9b5270-6010-43fc-aea7-078f87a7a198/istio-proxy/4.log" Sep 10 21:03:08.971438 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:03:08.971408 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 40s restarting failed container=istio-proxy pod=maas-default-gateway-openshift-default-697c686cf6-hlwbq_openshift-ingress(5b9b5270-6010-43fc-aea7-078f87a7a198)\"" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" Sep 10 21:03:09.537840 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.537806 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbc7b/must-gather-wqskm"] Sep 10 21:03:09.544008 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.543974 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.546787 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.546761 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vbc7b\"/\"default-dockercfg-b42ht\"" Sep 10 21:03:09.546927 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.546786 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbc7b\"/\"kube-root-ca.crt\"" Sep 10 21:03:09.547585 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.547548 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbc7b\"/\"openshift-service-ca.crt\"" Sep 10 21:03:09.550939 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.550915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbc7b/must-gather-wqskm"] Sep 10 21:03:09.692634 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.692599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hktkp\" (UniqueName: \"kubernetes.io/projected/67df403d-30be-434f-b381-fee05ed27ade-kube-api-access-hktkp\") pod \"must-gather-wqskm\" (UID: \"67df403d-30be-434f-b381-fee05ed27ade\") " pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.692789 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.692654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/67df403d-30be-434f-b381-fee05ed27ade-must-gather-output\") pod \"must-gather-wqskm\" (UID: \"67df403d-30be-434f-b381-fee05ed27ade\") " pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.794350 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.794252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hktkp\" (UniqueName: \"kubernetes.io/projected/67df403d-30be-434f-b381-fee05ed27ade-kube-api-access-hktkp\") pod \"must-gather-wqskm\" (UID: \"67df403d-30be-434f-b381-fee05ed27ade\") " pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.794350 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.794314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/67df403d-30be-434f-b381-fee05ed27ade-must-gather-output\") pod \"must-gather-wqskm\" (UID: \"67df403d-30be-434f-b381-fee05ed27ade\") " pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.794709 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.794689 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/67df403d-30be-434f-b381-fee05ed27ade-must-gather-output\") pod \"must-gather-wqskm\" (UID: \"67df403d-30be-434f-b381-fee05ed27ade\") " pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.804327 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.804297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hktkp\" (UniqueName: \"kubernetes.io/projected/67df403d-30be-434f-b381-fee05ed27ade-kube-api-access-hktkp\") pod \"must-gather-wqskm\" (UID: \"67df403d-30be-434f-b381-fee05ed27ade\") " pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.855630 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.855592 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbc7b/must-gather-wqskm" Sep 10 21:03:09.958987 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.958954 2563 generic.go:356] "Generic (PLEG): container finished" podID="5b9b5270-6010-43fc-aea7-078f87a7a198" containerID="e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042" exitCode=0 Sep 10 21:03:09.959157 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.959019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" event={"ID":"5b9b5270-6010-43fc-aea7-078f87a7a198","Type":"ContainerDied","Data":"e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042"} Sep 10 21:03:09.959157 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.959067 2563 scope.go:117] "RemoveContainer" containerID="8ea65ff5e5ad7629d7267d0d8109d24ab5ab43d9cd042907fcfac51d29b45954" Sep 10 21:03:09.959503 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:09.959482 2563 scope.go:117] "RemoveContainer" containerID="e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042" Sep 10 21:03:09.959768 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:03:09.959744 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 40s restarting failed container=istio-proxy pod=maas-default-gateway-openshift-default-697c686cf6-hlwbq_openshift-ingress(5b9b5270-6010-43fc-aea7-078f87a7a198)\"" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" Sep 10 21:03:10.126150 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:10.126126 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbc7b/must-gather-wqskm"] Sep 10 21:03:10.128443 ip-10-0-142-97 kubenswrapper[2563]: W0910 21:03:10.128407 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67df403d_30be_434f_b381_fee05ed27ade.slice/crio-c5c851d845ae82bec0b55dc3fedee8ffc3ae819e1a6b3745cdc85391690d14a5 WatchSource:0}: Error finding container c5c851d845ae82bec0b55dc3fedee8ffc3ae819e1a6b3745cdc85391690d14a5: Status 404 returned error can't find the container with id c5c851d845ae82bec0b55dc3fedee8ffc3ae819e1a6b3745cdc85391690d14a5 Sep 10 21:03:10.967500 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:10.967461 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbc7b/must-gather-wqskm" event={"ID":"67df403d-30be-434f-b381-fee05ed27ade","Type":"ContainerStarted","Data":"c5c851d845ae82bec0b55dc3fedee8ffc3ae819e1a6b3745cdc85391690d14a5"} Sep 10 21:03:11.980583 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:11.980513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbc7b/must-gather-wqskm" event={"ID":"67df403d-30be-434f-b381-fee05ed27ade","Type":"ContainerStarted","Data":"8f99a89ae4f72189763991067071a78a6fd91f20ce408b4c2d08556eed7f496b"} Sep 10 21:03:11.981259 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:11.981116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbc7b/must-gather-wqskm" event={"ID":"67df403d-30be-434f-b381-fee05ed27ade","Type":"ContainerStarted","Data":"e64fc7336decede058bb57053c47ab73bf11d44323084c09f9dd712afa341180"} Sep 10 21:03:11.998918 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:11.998868 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbc7b/must-gather-wqskm" podStartSLOduration=2.191606461 podStartE2EDuration="2.998849041s" totalImagesPullingTime="807.24258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:11.997181181 +0000 UTC m=+511.211736469" watchObservedRunningTime="2026-09-10 21:03:11.998849041 +0000 UTC m=+511.213404329" Sep 10 21:03:12.582539 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:12.582506 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-86jxv_3380d104-eb93-44ee-be7d-9ef83e8737c1/global-pull-secret-syncer/0.log" Sep 10 21:03:12.716804 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:12.716777 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7fqqt_1ce2b4ea-73dd-42d4-8589-0b7fe5498f3c/konnectivity-agent/0.log" Sep 10 21:03:12.825676 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:12.825613 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-97.ec2.internal_1e98489962299eff4ae2f4254cc6a1f1/haproxy/0.log" Sep 10 21:03:17.171005 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:17.170973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59c974bd48-rrwg6_5d87899c-59dc-4f83-8b5f-9553049e959a/authorino/0.log" Sep 10 21:03:17.335849 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:17.335820 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-926hb_5c6aa37d-0ff3-47c5-8cd3-3a9ed289b334/limitador/0.log" Sep 10 21:03:18.713423 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.713393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e37c3c5b-a99d-4548-8319-814c23b71a7b/alertmanager/0.log" Sep 10 21:03:18.736441 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.736404 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e37c3c5b-a99d-4548-8319-814c23b71a7b/config-reloader/0.log" Sep 10 21:03:18.762599 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.762549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e37c3c5b-a99d-4548-8319-814c23b71a7b/kube-rbac-proxy-web/0.log" Sep 10 21:03:18.786000 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.785952 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e37c3c5b-a99d-4548-8319-814c23b71a7b/kube-rbac-proxy/0.log" Sep 10 21:03:18.811851 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.811825 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e37c3c5b-a99d-4548-8319-814c23b71a7b/kube-rbac-proxy-metric/0.log" Sep 10 21:03:18.837966 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.837939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e37c3c5b-a99d-4548-8319-814c23b71a7b/prom-label-proxy/0.log" Sep 10 21:03:18.858742 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.858717 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e37c3c5b-a99d-4548-8319-814c23b71a7b/init-config-reloader/0.log" Sep 10 21:03:18.924710 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.924682 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jdhxx_742200fb-0b2b-4caa-96a3-3055f0a93f0c/kube-state-metrics/0.log" Sep 10 21:03:18.942618 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.942591 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jdhxx_742200fb-0b2b-4caa-96a3-3055f0a93f0c/kube-rbac-proxy-main/0.log" Sep 10 21:03:18.968147 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:18.968068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jdhxx_742200fb-0b2b-4caa-96a3-3055f0a93f0c/kube-rbac-proxy-self/0.log" Sep 10 21:03:19.001198 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.001157 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-687f6465c8-2gsx6_3e4ce871-d805-4cd9-81f6-5774632621e5/metrics-server/0.log" Sep 10 21:03:19.026327 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.026300 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-h4wkm_c9995420-865e-4a16-8a38-4a10bc3d5d03/monitoring-plugin/0.log" Sep 10 21:03:19.228896 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.228864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtbhl_d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0/node-exporter/0.log" Sep 10 21:03:19.255159 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.255135 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtbhl_d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0/kube-rbac-proxy/0.log" Sep 10 21:03:19.283839 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.283812 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtbhl_d613cb67-36e2-41a8-b1bc-bf9cc9f38fe0/init-textfile/0.log" Sep 10 21:03:19.322121 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.322093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5cnzf_5733f1b8-d99d-4b42-94e4-250b23352806/kube-rbac-proxy-main/0.log" Sep 10 21:03:19.343829 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.343793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5cnzf_5733f1b8-d99d-4b42-94e4-250b23352806/kube-rbac-proxy-self/0.log" Sep 10 21:03:19.365535 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.365486 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-5cnzf_5733f1b8-d99d-4b42-94e4-250b23352806/openshift-state-metrics/0.log" Sep 10 21:03:19.407423 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.406759 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da333602-54cb-4f88-80d8-7ea1f294b214/prometheus/0.log" Sep 10 21:03:19.436314 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.436280 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da333602-54cb-4f88-80d8-7ea1f294b214/config-reloader/0.log" Sep 10 21:03:19.459616 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.459585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da333602-54cb-4f88-80d8-7ea1f294b214/thanos-sidecar/0.log" Sep 10 21:03:19.485685 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.485609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da333602-54cb-4f88-80d8-7ea1f294b214/kube-rbac-proxy-web/0.log" Sep 10 21:03:19.507357 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.507328 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da333602-54cb-4f88-80d8-7ea1f294b214/kube-rbac-proxy/0.log" Sep 10 21:03:19.527659 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.527630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da333602-54cb-4f88-80d8-7ea1f294b214/kube-rbac-proxy-thanos/0.log" Sep 10 21:03:19.550201 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.550146 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da333602-54cb-4f88-80d8-7ea1f294b214/init-config-reloader/0.log" Sep 10 21:03:19.577980 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.577952 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-9hjbj_301a9750-5ae1-4bb0-83de-046010e55d7a/prometheus-operator/0.log" Sep 10 21:03:19.600492 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.600446 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-9hjbj_301a9750-5ae1-4bb0-83de-046010e55d7a/kube-rbac-proxy/0.log" Sep 10 21:03:19.630147 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.630111 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-xx5lw_d41527bf-ee48-4843-916c-bbcc8e1a1c69/prometheus-operator-admission-webhook/0.log" Sep 10 21:03:19.675583 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.674391 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-556f85dd77-975xb_672bed44-02cb-4b85-8c2b-2deedf53b0d3/telemeter-client/0.log" Sep 10 21:03:19.712866 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.712839 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-556f85dd77-975xb_672bed44-02cb-4b85-8c2b-2deedf53b0d3/reload/0.log" Sep 10 21:03:19.746634 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.746543 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-556f85dd77-975xb_672bed44-02cb-4b85-8c2b-2deedf53b0d3/kube-rbac-proxy/0.log" Sep 10 21:03:19.792159 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.792116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6746d97d-h9dnh_8accc516-6533-4005-9ad2-5775751aecd8/thanos-query/0.log" Sep 10 21:03:19.817375 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.817342 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6746d97d-h9dnh_8accc516-6533-4005-9ad2-5775751aecd8/kube-rbac-proxy-web/0.log" Sep 10 21:03:19.839331 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.839303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6746d97d-h9dnh_8accc516-6533-4005-9ad2-5775751aecd8/kube-rbac-proxy/0.log" Sep 10 21:03:19.871654 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.871616 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6746d97d-h9dnh_8accc516-6533-4005-9ad2-5775751aecd8/prom-label-proxy/0.log" Sep 10 21:03:19.896492 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.896466 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6746d97d-h9dnh_8accc516-6533-4005-9ad2-5775751aecd8/kube-rbac-proxy-rules/0.log" Sep 10 21:03:19.918858 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:19.918825 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c6746d97d-h9dnh_8accc516-6533-4005-9ad2-5775751aecd8/kube-rbac-proxy-metrics/0.log" Sep 10 21:03:22.554220 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.554185 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-856777497b-k5bwk_b89f84db-b76e-4174-9a11-8c4633cc9548/console/0.log" Sep 10 21:03:22.695939 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.695901 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp"] Sep 10 21:03:22.703868 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.703833 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.708196 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.708166 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp"] Sep 10 21:03:22.735702 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.735663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7m4k\" (UniqueName: \"kubernetes.io/projected/cda1f95a-7524-4228-9050-9e8f3c7a38e8-kube-api-access-q7m4k\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.736047 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.736019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-podres\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.736195 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.736180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-proc\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.736302 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.736285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-lib-modules\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.736795 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.736590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-sys\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.837621 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.837508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-sys\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.837795 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.837626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7m4k\" (UniqueName: \"kubernetes.io/projected/cda1f95a-7524-4228-9050-9e8f3c7a38e8-kube-api-access-q7m4k\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.837795 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.837667 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-sys\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.837795 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.837710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-podres\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.837795 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.837750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-proc\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.837795 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.837774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-lib-modules\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.838064 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.837987 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-lib-modules\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.838130 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.838087 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-proc\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.838130 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.838118 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cda1f95a-7524-4228-9050-9e8f3c7a38e8-podres\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:22.849646 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:22.849606 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7m4k\" (UniqueName: \"kubernetes.io/projected/cda1f95a-7524-4228-9050-9e8f3c7a38e8-kube-api-access-q7m4k\") pod \"perf-node-gather-daemonset-4zcnp\" (UID: \"cda1f95a-7524-4228-9050-9e8f3c7a38e8\") " pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:23.019023 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:23.018986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:23.332702 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:23.332666 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp"] Sep 10 21:03:24.080972 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.080928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" event={"ID":"cda1f95a-7524-4228-9050-9e8f3c7a38e8","Type":"ContainerStarted","Data":"ed7ebab49eea3ff42e6ee381baf4567768890fd2fbe2dba732517f1267479f81"} Sep 10 21:03:24.081400 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.080983 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" event={"ID":"cda1f95a-7524-4228-9050-9e8f3c7a38e8","Type":"ContainerStarted","Data":"69d2af1b59349012b2372f61ef148c04de20ffa7ee5c26dd21bab6281969184d"} Sep 10 21:03:24.081400 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.081052 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:24.097700 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.097640 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" podStartSLOduration=2.097619033 podStartE2EDuration="2.097619033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:24.096136706 +0000 UTC m=+523.310692015" watchObservedRunningTime="2026-09-10 21:03:24.097619033 +0000 UTC m=+523.312174322" Sep 10 21:03:24.321546 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.321519 2563 scope.go:117] "RemoveContainer" containerID="e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042" Sep 10 21:03:24.321756 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:03:24.321735 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 40s restarting failed container=istio-proxy pod=maas-default-gateway-openshift-default-697c686cf6-hlwbq_openshift-ingress(5b9b5270-6010-43fc-aea7-078f87a7a198)\"" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" Sep 10 21:03:24.384252 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.384174 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g64kw_1d29f066-7f03-4068-99b0-351aac3953d9/dns/0.log" Sep 10 21:03:24.404121 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.404091 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g64kw_1d29f066-7f03-4068-99b0-351aac3953d9/kube-rbac-proxy/0.log" Sep 10 21:03:24.469597 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:24.469550 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4w2g6_7a261123-3ff1-4cd9-b17e-073352b72a75/dns-node-resolver/0.log" Sep 10 21:03:25.024738 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:25.024705 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ft759_cea5094b-f793-41e4-9177-f3daba3c0e1b/node-ca/0.log" Sep 10 21:03:25.929380 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:25.929344 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cz82q6_fbf1d1a0-f350-4509-97f7-1445bf3965a6/istio-proxy/0.log" Sep 10 21:03:26.045517 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:26.045480 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-697c686cf6-hlwbq_5b9b5270-6010-43fc-aea7-078f87a7a198/istio-proxy/4.log" Sep 10 21:03:26.045710 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:26.045535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-697c686cf6-hlwbq_5b9b5270-6010-43fc-aea7-078f87a7a198/istio-proxy/4.log" Sep 10 21:03:26.674780 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:26.674751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h5nm8_6c7daa87-6d73-41dd-a752-3a3bb06c8635/serve-healthcheck-canary/0.log" Sep 10 21:03:27.254147 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:27.254114 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-54nlv_89c2b812-b7d1-4957-9628-1146fb651e9a/kube-rbac-proxy/0.log" Sep 10 21:03:27.294936 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:27.294907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-54nlv_89c2b812-b7d1-4957-9628-1146fb651e9a/exporter/0.log" Sep 10 21:03:27.375742 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:27.375694 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-54nlv_89c2b812-b7d1-4957-9628-1146fb651e9a/extractor/0.log" Sep 10 21:03:29.378712 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:29.378684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d44794c8d-q2mqr_2a23960b-0c34-46bf-8286-3246622ea29b/manager/0.log" Sep 10 21:03:29.397533 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:29.397507 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d44794c8d-q2mqr_2a23960b-0c34-46bf-8286-3246622ea29b/copy-manifests/0.log" Sep 10 21:03:30.100494 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:30.100459 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vbc7b/perf-node-gather-daemonset-4zcnp" Sep 10 21:03:30.200727 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:30.200701 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cz82q6_fbf1d1a0-f350-4509-97f7-1445bf3965a6/istio-proxy/0.log" Sep 10 21:03:30.278941 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:30.278907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-697c686cf6-hlwbq_5b9b5270-6010-43fc-aea7-078f87a7a198/istio-proxy/4.log" Sep 10 21:03:30.278941 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:30.278925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-697c686cf6-hlwbq_5b9b5270-6010-43fc-aea7-078f87a7a198/istio-proxy/4.log" Sep 10 21:03:30.279164 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:30.279042 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6ffd7f7887-4cbxg_c728931b-9d8e-4111-81aa-e9734def6a1e/manager/0.log" Sep 10 21:03:31.301318 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:31.301289 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cz82q6_fbf1d1a0-f350-4509-97f7-1445bf3965a6/istio-proxy/0.log" Sep 10 21:03:31.388006 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:31.387966 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-697c686cf6-hlwbq_5b9b5270-6010-43fc-aea7-078f87a7a198/istio-proxy/4.log" Sep 10 21:03:31.388286 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:31.388116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-697c686cf6-hlwbq_5b9b5270-6010-43fc-aea7-078f87a7a198/istio-proxy/4.log" Sep 10 21:03:36.083915 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.083882 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kl5dl_026cbc27-4f88-49b1-855a-7fed14f763ca/kube-multus-additional-cni-plugins/0.log" Sep 10 21:03:36.103942 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.103916 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kl5dl_026cbc27-4f88-49b1-855a-7fed14f763ca/egress-router-binary-copy/0.log" Sep 10 21:03:36.121993 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.121943 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kl5dl_026cbc27-4f88-49b1-855a-7fed14f763ca/cni-plugins/0.log" Sep 10 21:03:36.141026 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.140992 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kl5dl_026cbc27-4f88-49b1-855a-7fed14f763ca/bond-cni-plugin/0.log" Sep 10 21:03:36.159422 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.159396 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kl5dl_026cbc27-4f88-49b1-855a-7fed14f763ca/routeoverride-cni/0.log" Sep 10 21:03:36.178406 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.178378 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kl5dl_026cbc27-4f88-49b1-855a-7fed14f763ca/whereabouts-cni-bincopy/0.log" Sep 10 21:03:36.197991 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.197959 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kl5dl_026cbc27-4f88-49b1-855a-7fed14f763ca/whereabouts-cni/0.log" Sep 10 21:03:36.511458 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.511430 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k9nd7_9cb35164-6807-49ec-a04c-ec048af380b8/kube-multus/0.log" Sep 10 21:03:36.627947 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.627917 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w6zkl_933b4eae-c038-460e-8ea7-bddfcdd99f60/network-metrics-daemon/0.log" Sep 10 21:03:36.649142 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:36.649119 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w6zkl_933b4eae-c038-460e-8ea7-bddfcdd99f60/kube-rbac-proxy/0.log" Sep 10 21:03:37.417187 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.417151 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/ovn-controller/0.log" Sep 10 21:03:37.431813 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.431782 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/ovn-acl-logging/0.log" Sep 10 21:03:37.452225 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.452193 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/kube-rbac-proxy-node/0.log" Sep 10 21:03:37.470069 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.470036 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 21:03:37.487289 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.487264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/northd/0.log" Sep 10 21:03:37.504963 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.504918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/nbdb/0.log" Sep 10 21:03:37.522322 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.522295 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/sbdb/0.log" Sep 10 21:03:37.559654 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:37.559624 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgbdq_07e3e1cd-c9a0-486e-a643-107f091b81ed/ovnkube-controller/0.log" Sep 10 21:03:38.320947 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:38.320906 2563 scope.go:117] "RemoveContainer" containerID="e000d51cf5ce1ca3d477ba40338e509775cf7a38d32a47e2df7f7e7602ff9042" Sep 10 21:03:38.321176 ip-10-0-142-97 kubenswrapper[2563]: E0910 21:03:38.321152 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"istio-proxy\" with CrashLoopBackOff: \"back-off 40s restarting failed container=istio-proxy pod=maas-default-gateway-openshift-default-697c686cf6-hlwbq_openshift-ingress(5b9b5270-6010-43fc-aea7-078f87a7a198)\"" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-hlwbq" podUID="5b9b5270-6010-43fc-aea7-078f87a7a198" Sep 10 21:03:39.035296 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:39.035258 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-s5kwb_06855ecc-d7cb-4421-acf4-ffb6543dbc6e/network-check-target-container/0.log" Sep 10 21:03:39.972906 ip-10-0-142-97 kubenswrapper[2563]: I0910 21:03:39.972819 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-m48xg_9fb7f6da-af74-4a3b-ac7c-50efa8f85665/iptables-alerter/0.log"