Sep 09 02:25:37.218227 ip-10-0-143-68 systemd[1]: Starting Kubernetes Kubelet... Sep 09 02:25:37.641099 ip-10-0-143-68 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 02:25:37.641099 ip-10-0-143-68 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 02:25:37.641099 ip-10-0-143-68 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 02:25:37.641099 ip-10-0-143-68 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 02:25:37.641099 ip-10-0-143-68 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 02:25:37.641836 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.641205 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 02:25:37.646412 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646365 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:37.646412 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646408 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:37.646412 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646414 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:37.646412 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646419 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646424 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646429 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646434 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646440 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646445 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646448 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646452 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646456 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646460 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646464 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646468 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646471 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646476 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646479 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646483 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646487 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646494 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646499 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646504 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:37.646661 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646508 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646513 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646517 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646521 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646526 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646531 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646535 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646539 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646543 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646550 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646554 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646559 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646563 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646568 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646573 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646578 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646582 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646586 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646590 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646594 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:37.647509 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646599 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646604 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646608 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646612 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646617 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646621 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646625 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646631 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646636 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646643 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646649 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646653 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646657 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646662 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646665 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646670 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646674 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646681 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646685 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:37.648427 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646689 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646694 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646698 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646702 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646706 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646711 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646715 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646720 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646724 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646729 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646733 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646737 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646742 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646746 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646750 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646754 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646758 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646763 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646767 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646771 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:37.649235 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646775 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646780 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646785 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646789 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646793 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646798 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646802 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646806 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646811 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646814 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646819 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646823 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646827 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646831 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646836 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646840 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.646846 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648091 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648106 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:37.650112 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648112 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648117 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648121 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648128 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648135 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648140 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648146 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648150 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648155 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648160 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648164 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648169 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648173 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648177 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648181 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648188 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648193 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648197 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648201 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:37.650893 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648206 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648210 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648214 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648218 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648223 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648227 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648231 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648238 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648243 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648248 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648254 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648258 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648263 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648268 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648274 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648280 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648284 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648288 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648293 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:37.651678 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648297 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648301 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648305 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648310 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648316 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648320 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648324 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648330 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648334 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648338 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648343 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648347 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648352 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648356 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648360 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648364 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648368 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648372 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648377 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:37.652202 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648381 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648386 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648389 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648394 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648398 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648402 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648407 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648412 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648417 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648421 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648425 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648429 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648433 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648437 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648443 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648447 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648451 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648455 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648460 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648464 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:37.652659 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648468 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648477 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648481 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648486 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648490 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648494 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648498 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648503 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648507 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648511 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648516 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648520 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648524 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648528 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648533 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648537 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648541 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648545 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.648549 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:37.653367 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649210 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649219 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649224 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649228 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649233 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649236 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649240 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649244 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649248 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649252 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649256 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649260 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649265 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649269 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649273 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649277 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649283 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649287 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649292 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649296 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:37.653876 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649300 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649305 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649309 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649313 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649318 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649322 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649327 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649333 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649340 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649345 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649349 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649353 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649357 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649362 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649366 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649370 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649374 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649379 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649383 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649387 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:37.654395 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649391 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649395 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649399 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649403 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649407 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649414 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649421 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649426 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649431 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649437 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649442 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649446 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649450 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649454 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649458 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649463 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649467 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649471 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649476 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:37.654972 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649480 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649485 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649489 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649493 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649497 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649501 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649505 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649509 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649513 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649517 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649521 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649526 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649530 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649534 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649538 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649543 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649548 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649552 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649556 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:37.655468 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649560 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649564 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649569 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649573 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649580 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649585 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649590 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649594 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649598 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649603 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649608 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649613 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649617 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649622 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649626 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649631 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649635 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649638 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649642 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649646 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:37.655962 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.649650 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649760 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649815 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649825 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649832 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649839 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649844 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649852 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649861 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649866 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649871 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649876 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649881 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649886 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649891 2581 flags.go:64] FLAG: --cgroup-root="" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649896 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649900 2581 flags.go:64] FLAG: --client-ca-file="" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649906 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649911 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649934 2581 flags.go:64] FLAG: --cluster-domain="" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649940 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649945 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649951 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649957 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 02:25:37.656452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649970 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649975 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649979 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649985 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649990 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649994 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.649999 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650005 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650010 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650017 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650021 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650026 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650030 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650036 2581 flags.go:64] FLAG: --enable-server="true" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650041 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650048 2581 flags.go:64] FLAG: --event-burst="100" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650053 2581 flags.go:64] FLAG: --event-qps="50" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650057 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650062 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650067 2581 flags.go:64] FLAG: --eviction-hard="" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650073 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650078 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650083 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650088 2581 flags.go:64] FLAG: --eviction-soft="" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650093 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 02:25:37.657167 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650098 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650104 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650109 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650113 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650118 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650126 2581 flags.go:64] FLAG: --feature-gates="" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650132 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650137 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650142 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650148 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650153 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650158 2581 flags.go:64] FLAG: --help="false" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650163 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-143-68.ec2.internal" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650168 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650172 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650177 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650182 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650188 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650193 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650198 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650202 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650207 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650212 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650217 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 02:25:37.657831 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650221 2581 flags.go:64] FLAG: --kube-reserved="" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650226 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650231 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650236 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650240 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650245 2581 flags.go:64] FLAG: --lock-file="" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650249 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650254 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650259 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650268 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650274 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650279 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650284 2581 flags.go:64] FLAG: --logging-format="text" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650291 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650297 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650301 2581 flags.go:64] FLAG: --manifest-url="" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650306 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650313 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650319 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650326 2581 flags.go:64] FLAG: --max-pods="110" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650331 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650335 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650340 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650345 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650350 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 02:25:37.658505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650354 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650360 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650371 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650376 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650380 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650385 2581 flags.go:64] FLAG: --pod-cidr="" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650390 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650400 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650405 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650410 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650415 2581 flags.go:64] FLAG: --port="10250" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650420 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650424 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c918470da29103f" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650430 2581 flags.go:64] FLAG: --qos-reserved="" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650435 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650440 2581 flags.go:64] FLAG: --register-node="true" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650445 2581 flags.go:64] FLAG: --register-with-taints="" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650451 2581 flags.go:64] FLAG: --registry-burst="10" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650456 2581 flags.go:64] FLAG: --registry-qps="5" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650461 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650466 2581 flags.go:64] FLAG: --reserved-memory="" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650473 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650479 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650484 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650489 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 02:25:37.659210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650493 2581 flags.go:64] FLAG: --runonce="false" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650498 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650503 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650507 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650512 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650517 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650522 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650527 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650532 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650536 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650541 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650546 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650550 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650555 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650560 2581 flags.go:64] FLAG: --system-cgroups="" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650565 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650574 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650579 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650612 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650621 2581 flags.go:64] FLAG: --tls-min-version="" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650626 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650631 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650636 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650641 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650646 2581 flags.go:64] FLAG: --v="2" Sep 09 02:25:37.659907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650652 2581 flags.go:64] FLAG: --version="false" Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650660 2581 flags.go:64] FLAG: --vmodule="" Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650666 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.650673 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650902 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650911 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650915 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650935 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650943 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650950 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650954 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650959 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650964 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650969 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650974 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650978 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650983 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650987 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650991 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:37.660636 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.650996 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651000 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651005 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651009 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651013 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651017 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651022 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651026 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651030 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651035 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651039 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651044 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651048 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651052 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651057 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651062 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651069 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651074 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651078 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651082 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:37.661171 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651087 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651091 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651095 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651099 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651104 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651107 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651112 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651116 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651120 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651125 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651129 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651135 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651141 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651146 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651150 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651154 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651159 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651163 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651167 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651171 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:37.661703 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651175 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651179 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651184 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651188 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651192 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651196 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651203 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651207 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651214 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651219 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651223 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651227 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651231 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651235 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651240 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651244 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651248 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651252 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651256 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651261 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:37.662225 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651265 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651269 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651275 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651281 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651286 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651291 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651296 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651300 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651305 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651309 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651314 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651318 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651323 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651327 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651332 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651337 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651341 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651345 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651352 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651356 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:37.662714 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651362 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651368 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651372 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.651376 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.651384 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.659605 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.659623 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.659643 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.659648 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659706 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659712 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659716 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659719 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659723 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:37.663254 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659727 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659731 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659734 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659737 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659740 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659742 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659745 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659748 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659751 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659753 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659756 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659759 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659761 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659764 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659767 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659770 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659773 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659775 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659778 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659781 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:37.663616 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659784 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659787 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659790 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659792 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659796 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659798 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659801 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659804 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659806 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659809 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659811 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659814 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659817 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659819 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659822 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659825 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659827 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659830 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659834 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659838 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:37.664260 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659840 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659843 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659846 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659848 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659851 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659853 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659856 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659858 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659861 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659864 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659866 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659869 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659872 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659875 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659878 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659881 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659884 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659886 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659889 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659892 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:37.664765 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659894 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659897 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659899 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659902 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659905 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659907 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659910 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659913 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659916 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659931 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659934 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659937 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659940 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659942 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659945 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659948 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659951 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659953 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659956 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659958 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:37.665289 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659961 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659964 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659966 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659969 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659971 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659975 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659977 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659981 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659985 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659988 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659992 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659994 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.659997 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660000 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:37.665860 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.660005 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660159 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660163 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660167 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660170 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660173 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660176 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660179 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660182 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660185 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660188 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660191 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660193 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660196 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660199 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660202 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660204 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660207 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660209 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660211 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:37.666345 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660214 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660216 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660219 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660221 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660230 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660233 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660236 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660239 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660243 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660246 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660249 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660252 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660255 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660258 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660260 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660263 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660265 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660269 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:37.667147 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660272 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660276 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660279 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660282 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660285 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660288 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660291 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660294 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660296 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660299 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660302 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660304 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660307 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660310 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660313 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660316 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660319 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660321 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660324 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:37.667612 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660334 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660337 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660340 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660343 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660345 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660348 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660350 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660353 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660356 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660358 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660361 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660363 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660366 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660368 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660370 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660373 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660375 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660378 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660380 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660383 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:37.668302 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660385 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660388 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660390 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660393 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660395 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660398 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660400 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660406 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660408 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660411 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660414 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660416 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660419 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660422 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660425 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660427 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660430 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660433 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660435 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660438 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660440 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:37.668821 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660443 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:37.660446 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.660451 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.660577 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.662876 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.663959 2581 server.go:1019] "Starting client certificate rotation" Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.664072 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.664116 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 02:25:37.669380 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.666798 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 02:25:37.672772 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.672756 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 02:25:37.686637 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.686616 2581 log.go:25] "Validated CRI v1 runtime API" Sep 09 02:25:37.689878 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.689859 2581 log.go:25] "Validated CRI v1 image API" Sep 09 02:25:37.690699 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.690683 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 02:25:37.692916 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.692898 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 02:25:37.694180 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.694160 2581 fs.go:135] Filesystem UUIDs: map[406c85df-bc5b-48d6-bbc5-6536ff19fea9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ef51ff74-ad96-47ef-bc6c-c9b8244b3d48:/dev/nvme0n1p3] Sep 09 02:25:37.694225 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.694180 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 02:25:37.700582 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.700463 2581 manager.go:216] Machine: {Timestamp:2026-09-09 02:25:37.699021003 +0000 UTC m=+0.360557073 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099919 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21959f42bcb00382a32e58977d2f06 SystemUUID:ec21959f-42bc-b003-82a3-2e58977d2f06 BootID:c424ef33-bd2b-4009-830b-fa615b49284c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:43:3e:50:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:43:3e:50:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:34:43:07:b3:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 02:25:37.700582 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.700576 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 02:25:37.700689 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.700666 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 02:25:37.704538 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.704508 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 02:25:37.704682 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.704540 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 02:25:37.705409 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.705399 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 02:25:37.705448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.705412 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 02:25:37.705448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.705419 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 02:25:37.706255 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.706244 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 02:25:37.707976 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.707965 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 02:25:37.711688 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.711675 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 09 02:25:37.711815 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.711805 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 02:25:37.711857 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.711837 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 09 02:25:37.711857 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.711857 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 02:25:37.711941 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.711869 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 02:25:37.711941 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.711880 2581 kubelet.go:398] "Adding apiserver pod source" Sep 09 02:25:37.711941 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.711890 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 02:25:37.712291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.712278 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 02:25:37.712330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.712298 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 02:25:37.714814 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.714792 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 02:25:37.717955 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.717940 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 02:25:37.718028 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.717971 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 02:25:37.718178 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718164 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 02:25:37.718212 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718188 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 02:25:37.718212 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718201 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 02:25:37.718280 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718213 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 02:25:37.718280 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718226 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 02:25:37.718280 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718234 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 02:25:37.718820 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718810 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 02:25:37.718820 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718820 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 02:25:37.718881 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718828 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 02:25:37.718881 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718833 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 02:25:37.718881 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718842 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 02:25:37.718881 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.718849 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 02:25:37.719730 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.719713 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mjvbg" Sep 09 02:25:37.720466 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.720453 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 02:25:37.720466 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.720464 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 02:25:37.721088 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.721065 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 02:25:37.721180 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.721107 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 02:25:37.723951 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.723892 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 02:25:37.724828 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.724806 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mjvbg" Sep 09 02:25:37.726301 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.726284 2581 server.go:1268] "Started kubelet" Sep 09 02:25:37.726393 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.726363 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 02:25:37.726501 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.726458 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 02:25:37.726537 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.726525 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 02:25:37.727215 ip-10-0-143-68 systemd[1]: Started Kubernetes Kubelet. Sep 09 02:25:37.727967 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.727949 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 02:25:37.728869 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.728845 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 09 02:25:37.732582 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.732423 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 02:25:37.732582 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.731375 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-68.ec2.internal.18d385eecf80cfe3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-68.ec2.internal,UID:ip-10-0-143-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-68.ec2.internal,},FirstTimestamp:2026-09-09 02:25:37.726255075 +0000 UTC m=+0.387791139,LastTimestamp:2026-09-09 02:25:37.726255075 +0000 UTC m=+0.387791139,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-68.ec2.internal,}" Sep 09 02:25:37.733080 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.733067 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 02:25:37.733080 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.733074 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 02:25:37.733189 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.733172 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:37.733914 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.733897 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 02:25:37.733914 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.733900 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 02:25:37.734048 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.733934 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 02:25:37.734048 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734023 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 09 02:25:37.734048 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734029 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 09 02:25:37.734504 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734487 2581 factory.go:55] Registering systemd factory Sep 09 02:25:37.734595 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734523 2581 factory.go:223] Registration of the systemd container factory successfully Sep 09 02:25:37.734714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734701 2581 factory.go:153] Registering CRI-O factory Sep 09 02:25:37.734714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734720 2581 factory.go:223] Registration of the crio container factory successfully Sep 09 02:25:37.734823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734773 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 02:25:37.734823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734795 2581 factory.go:103] Registering Raw factory Sep 09 02:25:37.734823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.734816 2581 manager.go:1196] Started watching for new ooms in manager Sep 09 02:25:37.735361 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.735342 2581 manager.go:349] Starting recovery of all containers Sep 09 02:25:37.743339 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.743308 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:37.745999 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.745968 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-68.ec2.internal\" not found" node="ip-10-0-143-68.ec2.internal" Sep 09 02:25:37.749135 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.749115 2581 manager.go:354] Recovery completed Sep 09 02:25:37.756206 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.756190 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:37.758141 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.758124 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:37.758228 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.758159 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:37.758228 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.758174 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:37.758755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.758741 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 02:25:37.758755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.758749 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:37.758755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.758753 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 02:25:37.758887 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.758772 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 09 02:25:37.759507 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.759483 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:37.759593 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.759519 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:37.759593 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.759539 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:37.759958 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.759916 2581 policy_none.go:49] "None policy: Start" Sep 09 02:25:37.759999 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.759963 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 02:25:37.759999 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.759974 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 02:25:37.761068 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.761057 2581 policy_none.go:47] "Start" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.801511 2581 manager.go:337] "Starting Device Plugin manager" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.801550 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.801560 2581 server.go:87] "Starting device plugin registration server" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.801982 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.801994 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.802098 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.802180 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.802190 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.802733 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 02:25:37.803796 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.802783 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:37.838122 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.838086 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 02:25:37.839377 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.839361 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 02:25:37.839447 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.839414 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 02:25:37.839447 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.839446 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 02:25:37.839552 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.839489 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 02:25:37.841494 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.841470 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:37.902448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.902327 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:37.903706 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.903687 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:37.903824 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.903718 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:37.903824 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.903730 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:37.903824 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.903754 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-68.ec2.internal" Sep 09 02:25:37.911162 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.911143 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-68.ec2.internal" Sep 09 02:25:37.911223 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.911171 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-68.ec2.internal\": node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:37.929780 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.929750 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:37.939800 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.939760 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal"] Sep 09 02:25:37.939943 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.939834 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:37.940810 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.940794 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:37.940897 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.940822 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:37.940897 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.940835 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:37.942796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.942783 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:37.942932 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.942905 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Sep 09 02:25:37.943010 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.942946 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:37.943520 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.943508 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:37.943588 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.943520 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:37.943588 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.943540 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:37.943588 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.943551 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:37.943588 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.943552 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:37.943588 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.943565 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:37.945364 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.945348 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:37.945416 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.945381 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:37.946172 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.946154 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:37.946254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.946188 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:37.946254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:37.946202 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:37.972879 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.972844 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-68.ec2.internal\" not found" node="ip-10-0-143-68.ec2.internal" Sep 09 02:25:37.977282 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:37.977266 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-68.ec2.internal\" not found" node="ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.030749 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.030716 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:38.035493 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.035475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f92ac1b31a30df9df346e8510b9d388a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-68.ec2.internal\" (UID: \"f92ac1b31a30df9df346e8510b9d388a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.035572 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.035523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a72ae829bbdbcdbe438cd1ad052311c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"a72ae829bbdbcdbe438cd1ad052311c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.035572 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.035552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a72ae829bbdbcdbe438cd1ad052311c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"a72ae829bbdbcdbe438cd1ad052311c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.131465 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.131436 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:38.135768 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.135749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f92ac1b31a30df9df346e8510b9d388a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-68.ec2.internal\" (UID: \"f92ac1b31a30df9df346e8510b9d388a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.135828 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.135781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a72ae829bbdbcdbe438cd1ad052311c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"a72ae829bbdbcdbe438cd1ad052311c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.135828 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.135800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a72ae829bbdbcdbe438cd1ad052311c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"a72ae829bbdbcdbe438cd1ad052311c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.135828 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.135827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a72ae829bbdbcdbe438cd1ad052311c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"a72ae829bbdbcdbe438cd1ad052311c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.135971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.135840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f92ac1b31a30df9df346e8510b9d388a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-68.ec2.internal\" (UID: \"f92ac1b31a30df9df346e8510b9d388a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.135971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.135874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a72ae829bbdbcdbe438cd1ad052311c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal\" (UID: \"a72ae829bbdbcdbe438cd1ad052311c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.232254 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.232190 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:38.275709 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.275686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.280268 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.280078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.332498 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.332463 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:38.433522 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.433485 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:38.534048 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.533950 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:38.634171 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.634127 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-68.ec2.internal\" not found" Sep 09 02:25:38.664767 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.664726 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 02:25:38.665325 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.664937 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 02:25:38.665325 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.664977 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 02:25:38.705361 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.705328 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:38.712699 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.712677 2581 apiserver.go:52] "Watching apiserver" Sep 09 02:25:38.722064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.722038 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 02:25:38.722500 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.722478 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rvgmh","kube-system/konnectivity-agent-z6swx","openshift-cluster-node-tuning-operator/tuned-5lw7l","openshift-dns/node-resolver-mlxn4","openshift-ovn-kubernetes/ovnkube-node-gzpmf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc","openshift-image-registry/node-ca-z5zrm","openshift-multus/multus-additional-cni-plugins-fgngj","openshift-multus/multus-g9qkn","openshift-multus/network-metrics-daemon-6pdwv","openshift-network-diagnostics/network-check-target-fk762","openshift-network-operator/iptables-alerter-dgjwg"] Sep 09 02:25:38.725607 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.725588 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.725684 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.725666 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:38.728237 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.728220 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:38.731263 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.731219 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gmlff\"" Sep 09 02:25:38.731263 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.731236 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 02:25:38.731858 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.731806 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 02:20:38 +0000 UTC" deadline="2028-02-23 22:15:59.483721697 +0000 UTC" Sep 09 02:25:38.732575 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.731858 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12787h50m20.751868117s" Sep 09 02:25:38.732692 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.732582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 02:25:38.732763 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.732724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.733221 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.733169 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 02:25:38.733593 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.733561 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.734796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.734773 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 02:25:38.735126 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.735104 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4n4xn\"" Sep 09 02:25:38.735486 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.735468 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 02:25:38.736164 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.736144 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.738157 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-kubernetes\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysctl-conf\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-sys\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-lib-modules\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa36722e-12c0-41c2-823b-75349e052322-tmp\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-tmp-dir\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-dbus\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysconfig\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-run\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738379 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n4m9s\"" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6cpd\" (UniqueName: \"kubernetes.io/projected/aa36722e-12c0-41c2-823b-75349e052322-kube-api-access-z6cpd\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-hosts-file\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738390 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-kubelet-config\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738521 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7895003-734d-42df-9e10-721e3742ac12-agent-certs\") pod \"konnectivity-agent-z6swx\" (UID: \"c7895003-734d-42df-9e10-721e3742ac12\") " pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7895003-734d-42df-9e10-721e3742ac12-konnectivity-ca\") pod \"konnectivity-agent-z6swx\" (UID: \"c7895003-734d-42df-9e10-721e3742ac12\") " pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-modprobe-d\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysctl-d\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-var-lib-kubelet\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-systemd\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-host\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa36722e-12c0-41c2-823b-75349e052322-etc-tuned\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.738755 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.738667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qxb\" (UniqueName: \"kubernetes.io/projected/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-kube-api-access-27qxb\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.739675 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.739658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.741853 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.741803 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 02:25:38.741853 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.741826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cz8cv\"" Sep 09 02:25:38.742116 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.742011 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 02:25:38.742116 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.742039 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 02:25:38.742295 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.742274 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 02:25:38.742372 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.742295 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 02:25:38.742428 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.742391 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 02:25:38.742805 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.742737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.744952 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.744917 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 02:25:38.745051 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.745004 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" Sep 09 02:25:38.745295 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.745275 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.745389 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.745309 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 02:25:38.745389 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.745344 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-drsnw\"" Sep 09 02:25:38.745510 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.745396 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 02:25:38.745748 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.745722 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 02:25:38.747679 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.747662 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 02:25:38.747771 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.747724 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 02:25:38.747883 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.747867 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-752n6\"" Sep 09 02:25:38.747946 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.747891 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 02:25:38.747946 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.747900 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 02:25:38.748263 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.748250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.750567 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.750548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.750693 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.750568 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 02:25:38.750693 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.750576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 02:25:38.750852 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.750709 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2t5sf\"" Sep 09 02:25:38.750852 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.750712 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 02:25:38.751020 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.751003 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 02:25:38.751093 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.751078 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 02:25:38.752802 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.752786 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 02:25:38.753008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.752980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pqtjm\"" Sep 09 02:25:38.753008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.752997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:38.753135 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.753107 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:38.755488 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.755431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:38.755583 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.755525 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:38.757879 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.757841 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal"] Sep 09 02:25:38.757991 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.757944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.759210 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.759189 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 02:25:38.759426 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.759410 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal"] Sep 09 02:25:38.760173 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.760145 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 02:25:38.760242 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.760224 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gcgzc\"" Sep 09 02:25:38.760306 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.760242 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 02:25:38.760383 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.760369 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 02:25:38.768264 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.768232 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c8dnz" Sep 09 02:25:38.774788 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.774434 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c8dnz" Sep 09 02:25:38.835420 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.835397 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 02:25:38.838849 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.838825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:38.839008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.838855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-run-netns\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.838879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-cni-bin\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.838894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-cni-netd\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.838918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-modprobe-d\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.838942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-conf-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.839008 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.838981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-cnibin\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-kubelet\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-slash\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-systemd\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-modprobe-d\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-etc-kubernetes\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-host-slash\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpqrh\" (UniqueName: \"kubernetes.io/projected/fb996e5e-da82-4f88-b07a-76bb575b4fc0-kube-api-access-mpqrh\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-device-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysctl-conf\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-tmp-dir\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-cnibin\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-hostroot\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56d510b0-0b49-430b-a072-bc536507030c-multus-daemon-config\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.839312 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovnkube-config\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-run\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-multus-certs\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysctl-conf\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z67qq\" (UniqueName: \"kubernetes.io/projected/62eef3cd-26d0-428e-8de9-52ca6387d4b0-kube-api-access-z67qq\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-run\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysctl-d\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839523 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-tmp-dir\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839567 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysctl-d\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qxb\" (UniqueName: \"kubernetes.io/projected/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-kube-api-access-27qxb\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-socket-dir-parent\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-iptables-alerter-script\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-env-overrides\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa36722e-12c0-41c2-823b-75349e052322-etc-tuned\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-k8s-cni-cncf-io\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-etc-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovnkube-script-lib\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-kubernetes\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4hc\" (UniqueName: \"kubernetes.io/projected/56d510b0-0b49-430b-a072-bc536507030c-kube-api-access-mh4hc\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlnrs\" (UniqueName: \"kubernetes.io/projected/79ca6d29-ba35-4347-9237-4bcec72eafad-kube-api-access-wlnrs\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839933 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-ovn\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-hosts-file\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.839986 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-kubernetes\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56d510b0-0b49-430b-a072-bc536507030c-cni-binary-copy\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-node-log\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-kubelet-config\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-hosts-file\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7895003-734d-42df-9e10-721e3742ac12-agent-certs\") pod \"konnectivity-agent-z6swx\" (UID: \"c7895003-734d-42df-9e10-721e3742ac12\") " pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-var-lib-kubelet\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-cni-binary-copy\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.840664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-log-socket\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840228 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-kubelet-config\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840262 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-var-lib-kubelet\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qzqm\" (UniqueName: \"kubernetes.io/projected/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-kube-api-access-5qzqm\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-systemd-units\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-netns\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mntnq\" (UniqueName: \"kubernetes.io/projected/78da3fd3-157b-4409-97a6-ba963de0e8f0-kube-api-access-mntnq\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840330 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59jfw\" (UniqueName: \"kubernetes.io/projected/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-kube-api-access-59jfw\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-sys\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-lib-modules\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa36722e-12c0-41c2-823b-75349e052322-tmp\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-cni-bin\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-sys\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6cpd\" (UniqueName: \"kubernetes.io/projected/aa36722e-12c0-41c2-823b-75349e052322-kube-api-access-z6cpd\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.841448 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-cni-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-lib-modules\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.840850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-system-cni-dir\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-socket-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7895003-734d-42df-9e10-721e3742ac12-konnectivity-ca\") pod \"konnectivity-agent-z6swx\" (UID: \"c7895003-734d-42df-9e10-721e3742ac12\") " pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-var-lib-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovn-node-metrics-cert\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-systemd\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.841209 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-host\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.841284 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret podName:6e611bc0-3863-4aa4-a0fc-3271a812cf6e nodeName:}" failed. No retries permitted until 2026-09-09 02:25:39.34126269 +0000 UTC m=+2.002798764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret") pod "global-pull-secret-syncer-rvgmh" (UID: "6e611bc0-3863-4aa4-a0fc-3271a812cf6e") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841338 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-systemd\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.842330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-host\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-registration-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-host\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-serviceca\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-cni-multus\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841577 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-sys-fs\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-dbus\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7895003-734d-42df-9e10-721e3742ac12-konnectivity-ca\") pod \"konnectivity-agent-z6swx\" (UID: \"c7895003-734d-42df-9e10-721e3742ac12\") " pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysconfig\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-system-cni-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-kubelet\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841721 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa36722e-12c0-41c2-823b-75349e052322-etc-sysconfig\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.843097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.841835 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-dbus\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:38.844437 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.844313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa36722e-12c0-41c2-823b-75349e052322-tmp\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.844525 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.844365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa36722e-12c0-41c2-823b-75349e052322-etc-tuned\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.844569 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.844532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7895003-734d-42df-9e10-721e3742ac12-agent-certs\") pod \"konnectivity-agent-z6swx\" (UID: \"c7895003-734d-42df-9e10-721e3742ac12\") " pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:38.846879 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.846856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qxb\" (UniqueName: \"kubernetes.io/projected/686fcff3-3baf-4ef1-85af-45b2e7e7adb1-kube-api-access-27qxb\") pod \"node-resolver-mlxn4\" (UID: \"686fcff3-3baf-4ef1-85af-45b2e7e7adb1\") " pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:38.848240 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.848218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6cpd\" (UniqueName: \"kubernetes.io/projected/aa36722e-12c0-41c2-823b-75349e052322-kube-api-access-z6cpd\") pod \"tuned-5lw7l\" (UID: \"aa36722e-12c0-41c2-823b-75349e052322\") " pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:38.911686 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:38.911642 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92ac1b31a30df9df346e8510b9d388a.slice/crio-b4e4333e10b059266c855d9d0678293488b45b424a41f9017d529c701742393e WatchSource:0}: Error finding container b4e4333e10b059266c855d9d0678293488b45b424a41f9017d529c701742393e: Status 404 returned error can't find the container with id b4e4333e10b059266c855d9d0678293488b45b424a41f9017d529c701742393e Sep 09 02:25:38.911966 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:38.911923 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72ae829bbdbcdbe438cd1ad052311c0.slice/crio-24de3b0ba882482eb1cc078b44b3ae58e0624ddb8a7f86bb976274b6701f316b WatchSource:0}: Error finding container 24de3b0ba882482eb1cc078b44b3ae58e0624ddb8a7f86bb976274b6701f316b: Status 404 returned error can't find the container with id 24de3b0ba882482eb1cc078b44b3ae58e0624ddb8a7f86bb976274b6701f316b Sep 09 02:25:38.917664 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.917644 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 02:25:38.942039 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.941995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-cnibin\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-kubelet\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-slash\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-cnibin\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-systemd\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-etc-kubernetes\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-slash\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-host-slash\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-kubelet\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpqrh\" (UniqueName: \"kubernetes.io/projected/fb996e5e-da82-4f88-b07a-76bb575b4fc0-kube-api-access-mpqrh\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-etc-kubernetes\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-device-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.942202 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-host-slash\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-systemd\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-cnibin\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-hostroot\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56d510b0-0b49-430b-a072-bc536507030c-multus-daemon-config\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-cnibin\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-device-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-hostroot\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovnkube-config\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-multus-certs\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z67qq\" (UniqueName: \"kubernetes.io/projected/62eef3cd-26d0-428e-8de9-52ca6387d4b0-kube-api-access-z67qq\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-socket-dir-parent\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-multus-certs\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-iptables-alerter-script\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.942778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-env-overrides\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-k8s-cni-cncf-io\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-etc-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovnkube-script-lib\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4hc\" (UniqueName: \"kubernetes.io/projected/56d510b0-0b49-430b-a072-bc536507030c-kube-api-access-mh4hc\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlnrs\" (UniqueName: \"kubernetes.io/projected/79ca6d29-ba35-4347-9237-4bcec72eafad-kube-api-access-wlnrs\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-ovn\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56d510b0-0b49-430b-a072-bc536507030c-cni-binary-copy\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-node-log\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56d510b0-0b49-430b-a072-bc536507030c-multus-daemon-config\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-cni-binary-copy\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.942952 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovnkube-config\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-log-socket\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-log-socket\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.943789 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qzqm\" (UniqueName: \"kubernetes.io/projected/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-kube-api-access-5qzqm\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-run-ovn\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-systemd-units\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-netns\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943245 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-etc-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-node-log\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mntnq\" (UniqueName: \"kubernetes.io/projected/78da3fd3-157b-4409-97a6-ba963de0e8f0-kube-api-access-mntnq\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59jfw\" (UniqueName: \"kubernetes.io/projected/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-kube-api-access-59jfw\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-cni-bin\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-cni-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-system-cni-dir\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943442 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-socket-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-env-overrides\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943479 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-cni-binary-copy\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.944603 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-k8s-cni-cncf-io\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-systemd-units\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-var-lib-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-cni-bin\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56d510b0-0b49-430b-a072-bc536507030c-cni-binary-copy\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-run-netns\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovn-node-metrics-cert\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-system-cni-dir\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943698 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-socket-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-socket-dir-parent\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943655 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-var-lib-openvswitch\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-iptables-alerter-script\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-cni-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943763 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79ca6d29-ba35-4347-9237-4bcec72eafad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.945153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-registration-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-host\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-serviceca\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-cni-multus\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-host\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943900 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79ca6d29-ba35-4347-9237-4bcec72eafad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943914 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-registration-dir\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-sys-fs\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62eef3cd-26d0-428e-8de9-52ca6387d4b0-sys-fs\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-system-cni-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.943974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-cni-multus\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-kubelet\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-system-cni-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944076 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-host-var-lib-kubelet\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-run-netns\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.945714 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.944129 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944159 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-run-netns\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-cni-bin\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.944217 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs podName:78da3fd3-157b-4409-97a6-ba963de0e8f0 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:39.444196159 +0000 UTC m=+2.105732227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs") pod "network-metrics-daemon-6pdwv" (UID: "78da3fd3-157b-4409-97a6-ba963de0e8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944233 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-cni-bin\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-cni-netd\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovnkube-script-lib\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-conf-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944301 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-serviceca\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56d510b0-0b49-430b-a072-bc536507030c-multus-conf-dir\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.946276 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.944324 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb996e5e-da82-4f88-b07a-76bb575b4fc0-host-cni-netd\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.946580 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.946303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb996e5e-da82-4f88-b07a-76bb575b4fc0-ovn-node-metrics-cert\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.953447 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.953030 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:25:38.953447 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.953055 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:25:38.953447 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.953069 2581 projected.go:196] Error preparing data for projected volume kube-api-access-76w2z for pod openshift-network-diagnostics/network-check-target-fk762: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:38.953447 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:38.953164 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z podName:e9262767-c90e-4484-925b-20f9e5752a21 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:39.453142534 +0000 UTC m=+2.114678605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-76w2z" (UniqueName: "kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z") pod "network-check-target-fk762" (UID: "e9262767-c90e-4484-925b-20f9e5752a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:38.953447 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.953385 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpqrh\" (UniqueName: \"kubernetes.io/projected/fb996e5e-da82-4f88-b07a-76bb575b4fc0-kube-api-access-mpqrh\") pod \"ovnkube-node-gzpmf\" (UID: \"fb996e5e-da82-4f88-b07a-76bb575b4fc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:38.954386 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.954353 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlnrs\" (UniqueName: \"kubernetes.io/projected/79ca6d29-ba35-4347-9237-4bcec72eafad-kube-api-access-wlnrs\") pod \"multus-additional-cni-plugins-fgngj\" (UID: \"79ca6d29-ba35-4347-9237-4bcec72eafad\") " pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:38.954625 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.954606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4hc\" (UniqueName: \"kubernetes.io/projected/56d510b0-0b49-430b-a072-bc536507030c-kube-api-access-mh4hc\") pod \"multus-g9qkn\" (UID: \"56d510b0-0b49-430b-a072-bc536507030c\") " pod="openshift-multus/multus-g9qkn" Sep 09 02:25:38.954784 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.954761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z67qq\" (UniqueName: \"kubernetes.io/projected/62eef3cd-26d0-428e-8de9-52ca6387d4b0-kube-api-access-z67qq\") pod \"aws-ebs-csi-driver-node-kq2fc\" (UID: \"62eef3cd-26d0-428e-8de9-52ca6387d4b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:38.955316 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.955295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mntnq\" (UniqueName: \"kubernetes.io/projected/78da3fd3-157b-4409-97a6-ba963de0e8f0-kube-api-access-mntnq\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:38.955636 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.955618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qzqm\" (UniqueName: \"kubernetes.io/projected/1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568-kube-api-access-5qzqm\") pod \"node-ca-z5zrm\" (UID: \"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568\") " pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:38.955676 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:38.955637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59jfw\" (UniqueName: \"kubernetes.io/projected/92def037-6cd7-46cc-a8d9-27bf0a4ff6dc-kube-api-access-59jfw\") pod \"iptables-alerter-dgjwg\" (UID: \"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc\") " pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:39.057601 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.057513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:25:39.067931 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.067905 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7895003_734d_42df_9e10_721e3742ac12.slice/crio-6883021f69314e9f86a56f2bbe4cfcda9bfea059b64e6804dce223afccf04d51 WatchSource:0}: Error finding container 6883021f69314e9f86a56f2bbe4cfcda9bfea059b64e6804dce223afccf04d51: Status 404 returned error can't find the container with id 6883021f69314e9f86a56f2bbe4cfcda9bfea059b64e6804dce223afccf04d51 Sep 09 02:25:39.071122 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.071104 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" Sep 09 02:25:39.079226 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.079206 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa36722e_12c0_41c2_823b_75349e052322.slice/crio-669a83e817f2036072efa33e2e3e3b99c85baf5257db1ea814e09f93d439ea18 WatchSource:0}: Error finding container 669a83e817f2036072efa33e2e3e3b99c85baf5257db1ea814e09f93d439ea18: Status 404 returned error can't find the container with id 669a83e817f2036072efa33e2e3e3b99c85baf5257db1ea814e09f93d439ea18 Sep 09 02:25:39.085813 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.085792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mlxn4" Sep 09 02:25:39.089977 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.089955 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:25:39.094985 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.094961 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686fcff3_3baf_4ef1_85af_45b2e7e7adb1.slice/crio-3aba7bcd9605fc0a7f99f4614afca2b2358fe191ee69a5767d094c50c73b2e16 WatchSource:0}: Error finding container 3aba7bcd9605fc0a7f99f4614afca2b2358fe191ee69a5767d094c50c73b2e16: Status 404 returned error can't find the container with id 3aba7bcd9605fc0a7f99f4614afca2b2358fe191ee69a5767d094c50c73b2e16 Sep 09 02:25:39.101448 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.101423 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb996e5e_da82_4f88_b07a_76bb575b4fc0.slice/crio-7e7e602363d2bb16b7bb43c85a901fbeac584846de504cde2571a04cc05f80f3 WatchSource:0}: Error finding container 7e7e602363d2bb16b7bb43c85a901fbeac584846de504cde2571a04cc05f80f3: Status 404 returned error can't find the container with id 7e7e602363d2bb16b7bb43c85a901fbeac584846de504cde2571a04cc05f80f3 Sep 09 02:25:39.111412 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.111392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" Sep 09 02:25:39.121038 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.121014 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62eef3cd_26d0_428e_8de9_52ca6387d4b0.slice/crio-dc6bff919671b8c941b933ee4f1b25b030c11c5da4afcc92b80b0ff9b2cde6b3 WatchSource:0}: Error finding container dc6bff919671b8c941b933ee4f1b25b030c11c5da4afcc92b80b0ff9b2cde6b3: Status 404 returned error can't find the container with id dc6bff919671b8c941b933ee4f1b25b030c11c5da4afcc92b80b0ff9b2cde6b3 Sep 09 02:25:39.127158 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.127134 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z5zrm" Sep 09 02:25:39.133184 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.133162 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fgngj" Sep 09 02:25:39.135866 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.135836 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac3aafc_b20c_42f9_bb4b_d0f3bd7f0568.slice/crio-f420c08499e005052c7a05f21e45f85f7fc0878a3f0c629335129cd9f221a095 WatchSource:0}: Error finding container f420c08499e005052c7a05f21e45f85f7fc0878a3f0c629335129cd9f221a095: Status 404 returned error can't find the container with id f420c08499e005052c7a05f21e45f85f7fc0878a3f0c629335129cd9f221a095 Sep 09 02:25:39.136424 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.136381 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:39.142456 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.142428 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ca6d29_ba35_4347_9237_4bcec72eafad.slice/crio-a2ffff5ea10e7c6d7ab6676c8bb3d4f6133687f1afec828fc5ce64a026d87bad WatchSource:0}: Error finding container a2ffff5ea10e7c6d7ab6676c8bb3d4f6133687f1afec828fc5ce64a026d87bad: Status 404 returned error can't find the container with id a2ffff5ea10e7c6d7ab6676c8bb3d4f6133687f1afec828fc5ce64a026d87bad Sep 09 02:25:39.154874 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.154849 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g9qkn" Sep 09 02:25:39.159912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.159889 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dgjwg" Sep 09 02:25:39.164807 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.164784 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d510b0_0b49_430b_a072_bc536507030c.slice/crio-d4cec5e60d22db231a4955d2c2e59a377e8c3e7a33ea5799739ba9e0d41b16f8 WatchSource:0}: Error finding container d4cec5e60d22db231a4955d2c2e59a377e8c3e7a33ea5799739ba9e0d41b16f8: Status 404 returned error can't find the container with id d4cec5e60d22db231a4955d2c2e59a377e8c3e7a33ea5799739ba9e0d41b16f8 Sep 09 02:25:39.169757 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:25:39.169733 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92def037_6cd7_46cc_a8d9_27bf0a4ff6dc.slice/crio-2599b87aef1eeee80013fce58601fa7c0149915724fc0e7431108338451f7112 WatchSource:0}: Error finding container 2599b87aef1eeee80013fce58601fa7c0149915724fc0e7431108338451f7112: Status 404 returned error can't find the container with id 2599b87aef1eeee80013fce58601fa7c0149915724fc0e7431108338451f7112 Sep 09 02:25:39.347826 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.347793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:39.348021 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.347912 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:39.348021 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.347985 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret podName:6e611bc0-3863-4aa4-a0fc-3271a812cf6e nodeName:}" failed. No retries permitted until 2026-09-09 02:25:40.34796963 +0000 UTC m=+3.009505697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret") pod "global-pull-secret-syncer-rvgmh" (UID: "6e611bc0-3863-4aa4-a0fc-3271a812cf6e") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:39.448190 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.448152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:39.448388 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.448350 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:39.448439 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.448429 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs podName:78da3fd3-157b-4409-97a6-ba963de0e8f0 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:40.448407652 +0000 UTC m=+3.109943724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs") pod "network-metrics-daemon-6pdwv" (UID: "78da3fd3-157b-4409-97a6-ba963de0e8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:39.549114 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.549074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:39.549321 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.549275 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:25:39.549321 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.549300 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:25:39.549321 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.549314 2581 projected.go:196] Error preparing data for projected volume kube-api-access-76w2z for pod openshift-network-diagnostics/network-check-target-fk762: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:39.549487 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:39.549379 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z podName:e9262767-c90e-4484-925b-20f9e5752a21 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:40.549358008 +0000 UTC m=+3.210894077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-76w2z" (UniqueName: "kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z") pod "network-check-target-fk762" (UID: "e9262767-c90e-4484-925b-20f9e5752a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:39.778427 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.778243 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 02:20:39 +0000 UTC" deadline="2028-04-16 21:28:58.383621994 +0000 UTC" Sep 09 02:25:39.778427 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.778308 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14059h3m18.605318926s" Sep 09 02:25:39.874534 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.874399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dgjwg" event={"ID":"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc","Type":"ContainerStarted","Data":"2599b87aef1eeee80013fce58601fa7c0149915724fc0e7431108338451f7112"} Sep 09 02:25:39.879844 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.879740 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerStarted","Data":"a2ffff5ea10e7c6d7ab6676c8bb3d4f6133687f1afec828fc5ce64a026d87bad"} Sep 09 02:25:39.898268 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.898229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" event={"ID":"62eef3cd-26d0-428e-8de9-52ca6387d4b0","Type":"ContainerStarted","Data":"dc6bff919671b8c941b933ee4f1b25b030c11c5da4afcc92b80b0ff9b2cde6b3"} Sep 09 02:25:39.903445 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.903413 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"7e7e602363d2bb16b7bb43c85a901fbeac584846de504cde2571a04cc05f80f3"} Sep 09 02:25:39.907073 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.907041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mlxn4" event={"ID":"686fcff3-3baf-4ef1-85af-45b2e7e7adb1","Type":"ContainerStarted","Data":"3aba7bcd9605fc0a7f99f4614afca2b2358fe191ee69a5767d094c50c73b2e16"} Sep 09 02:25:39.910247 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.910216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" event={"ID":"f92ac1b31a30df9df346e8510b9d388a","Type":"ContainerStarted","Data":"b4e4333e10b059266c855d9d0678293488b45b424a41f9017d529c701742393e"} Sep 09 02:25:39.926308 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.926276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" event={"ID":"a72ae829bbdbcdbe438cd1ad052311c0","Type":"ContainerStarted","Data":"24de3b0ba882482eb1cc078b44b3ae58e0624ddb8a7f86bb976274b6701f316b"} Sep 09 02:25:39.933732 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.933697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g9qkn" event={"ID":"56d510b0-0b49-430b-a072-bc536507030c","Type":"ContainerStarted","Data":"d4cec5e60d22db231a4955d2c2e59a377e8c3e7a33ea5799739ba9e0d41b16f8"} Sep 09 02:25:39.937579 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.937546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z5zrm" event={"ID":"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568","Type":"ContainerStarted","Data":"f420c08499e005052c7a05f21e45f85f7fc0878a3f0c629335129cd9f221a095"} Sep 09 02:25:39.946137 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.946101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" event={"ID":"aa36722e-12c0-41c2-823b-75349e052322","Type":"ContainerStarted","Data":"669a83e817f2036072efa33e2e3e3b99c85baf5257db1ea814e09f93d439ea18"} Sep 09 02:25:39.950797 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:39.950765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z6swx" event={"ID":"c7895003-734d-42df-9e10-721e3742ac12","Type":"ContainerStarted","Data":"6883021f69314e9f86a56f2bbe4cfcda9bfea059b64e6804dce223afccf04d51"} Sep 09 02:25:40.029022 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.028911 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:40.077145 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.077113 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:40.362019 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.356013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:40.365505 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.364547 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:40.365505 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.364648 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret podName:6e611bc0-3863-4aa4-a0fc-3271a812cf6e nodeName:}" failed. No retries permitted until 2026-09-09 02:25:42.364624446 +0000 UTC m=+5.026160500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret") pod "global-pull-secret-syncer-rvgmh" (UID: "6e611bc0-3863-4aa4-a0fc-3271a812cf6e") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:40.457337 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.456618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:40.457337 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.456869 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:40.457337 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.456939 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs podName:78da3fd3-157b-4409-97a6-ba963de0e8f0 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:42.456918351 +0000 UTC m=+5.118454422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs") pod "network-metrics-daemon-6pdwv" (UID: "78da3fd3-157b-4409-97a6-ba963de0e8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:40.557392 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.557344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:40.557593 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.557545 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:25:40.557593 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.557577 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:25:40.557593 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.557591 2581 projected.go:196] Error preparing data for projected volume kube-api-access-76w2z for pod openshift-network-diagnostics/network-check-target-fk762: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:40.557761 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.557661 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z podName:e9262767-c90e-4484-925b-20f9e5752a21 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:42.55764099 +0000 UTC m=+5.219177060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-76w2z" (UniqueName: "kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z") pod "network-check-target-fk762" (UID: "e9262767-c90e-4484-925b-20f9e5752a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:40.778800 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.778679 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 02:20:39 +0000 UTC" deadline="2028-03-01 07:32:48.330791882 +0000 UTC" Sep 09 02:25:40.778800 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.778747 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12941h7m7.552050198s" Sep 09 02:25:40.840515 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.840477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:40.840715 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.840641 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:40.841217 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.841192 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:40.841331 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.841307 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:40.841406 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:40.841387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:40.841487 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:40.841466 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:42.371950 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:42.371908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:42.372466 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.372084 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:42.372466 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.372161 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret podName:6e611bc0-3863-4aa4-a0fc-3271a812cf6e nodeName:}" failed. No retries permitted until 2026-09-09 02:25:46.372140545 +0000 UTC m=+9.033676619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret") pod "global-pull-secret-syncer-rvgmh" (UID: "6e611bc0-3863-4aa4-a0fc-3271a812cf6e") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:42.472700 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:42.472655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:42.472980 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.472911 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:42.473171 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.473006 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs podName:78da3fd3-157b-4409-97a6-ba963de0e8f0 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:46.47298305 +0000 UTC m=+9.134519129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs") pod "network-metrics-daemon-6pdwv" (UID: "78da3fd3-157b-4409-97a6-ba963de0e8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:42.573862 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:42.573820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:42.574065 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.574032 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:25:42.574065 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.574054 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:25:42.574211 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.574068 2581 projected.go:196] Error preparing data for projected volume kube-api-access-76w2z for pod openshift-network-diagnostics/network-check-target-fk762: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:42.574211 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.574133 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z podName:e9262767-c90e-4484-925b-20f9e5752a21 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:46.574111328 +0000 UTC m=+9.235647384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-76w2z" (UniqueName: "kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z") pod "network-check-target-fk762" (UID: "e9262767-c90e-4484-925b-20f9e5752a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:42.840775 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:42.840744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:42.840775 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:42.840764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:42.841090 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:42.840764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:42.841090 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.840917 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:42.841090 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.841013 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:42.841261 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:42.841113 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:44.840376 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:44.840339 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:44.840954 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:44.840464 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:44.840954 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:44.840824 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:44.840954 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:44.840917 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:44.841114 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:44.840978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:44.841114 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:44.841097 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:46.408238 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:46.408194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:46.408673 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.408375 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:46.408673 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.408448 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret podName:6e611bc0-3863-4aa4-a0fc-3271a812cf6e nodeName:}" failed. No retries permitted until 2026-09-09 02:25:54.408431283 +0000 UTC m=+17.069967355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret") pod "global-pull-secret-syncer-rvgmh" (UID: "6e611bc0-3863-4aa4-a0fc-3271a812cf6e") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:46.509639 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:46.509597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:46.509827 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.509737 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:46.509827 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.509801 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs podName:78da3fd3-157b-4409-97a6-ba963de0e8f0 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:54.509785784 +0000 UTC m=+17.171321847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs") pod "network-metrics-daemon-6pdwv" (UID: "78da3fd3-157b-4409-97a6-ba963de0e8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:46.611080 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:46.610482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:46.611080 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.610692 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:25:46.611080 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.610716 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:25:46.611080 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.610729 2581 projected.go:196] Error preparing data for projected volume kube-api-access-76w2z for pod openshift-network-diagnostics/network-check-target-fk762: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:46.611080 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.610791 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z podName:e9262767-c90e-4484-925b-20f9e5752a21 nodeName:}" failed. No retries permitted until 2026-09-09 02:25:54.61077062 +0000 UTC m=+17.272306677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-76w2z" (UniqueName: "kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z") pod "network-check-target-fk762" (UID: "e9262767-c90e-4484-925b-20f9e5752a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:46.840150 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:46.840114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:46.840338 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:46.840127 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:46.840338 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.840289 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:46.840338 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:46.840127 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:46.840513 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.840339 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:46.840513 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:46.840398 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:48.839698 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:48.839666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:48.840319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:48.839666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:48.840319 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:48.839838 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:48.840319 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:48.839855 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:48.840319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:48.839681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:48.840319 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:48.839964 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:50.840145 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:50.840077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:50.840145 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:50.840095 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:50.840605 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:50.840191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:50.840605 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:50.840209 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:50.840605 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:50.840289 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:50.840605 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:50.840368 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:52.839829 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:52.839789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:52.840319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:52.839789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:52.840319 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:52.839942 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:52.840319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:52.839788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:52.840319 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:52.840025 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:52.840319 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:52.840114 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:54.472021 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:54.471916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:54.472458 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.472109 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:54.472458 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.472207 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret podName:6e611bc0-3863-4aa4-a0fc-3271a812cf6e nodeName:}" failed. No retries permitted until 2026-09-09 02:26:10.472185727 +0000 UTC m=+33.133721796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret") pod "global-pull-secret-syncer-rvgmh" (UID: "6e611bc0-3863-4aa4-a0fc-3271a812cf6e") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:54.572306 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:54.572262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:54.572468 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.572434 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:54.572532 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.572510 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs podName:78da3fd3-157b-4409-97a6-ba963de0e8f0 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:10.572494082 +0000 UTC m=+33.234030148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs") pod "network-metrics-daemon-6pdwv" (UID: "78da3fd3-157b-4409-97a6-ba963de0e8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:54.673590 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:54.673556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:54.673798 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.673756 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:25:54.673798 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.673799 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:25:54.674004 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.673813 2581 projected.go:196] Error preparing data for projected volume kube-api-access-76w2z for pod openshift-network-diagnostics/network-check-target-fk762: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:54.674004 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.673876 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z podName:e9262767-c90e-4484-925b-20f9e5752a21 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:10.673857905 +0000 UTC m=+33.335393978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-76w2z" (UniqueName: "kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z") pod "network-check-target-fk762" (UID: "e9262767-c90e-4484-925b-20f9e5752a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:54.840310 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:54.840268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:54.840310 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:54.840310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:54.840531 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:54.840310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:54.840531 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.840405 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:54.840531 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.840506 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:54.840637 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:54.840589 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:56.840290 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:56.840237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:56.840290 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:56.840284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:56.840770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:56.840284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:56.840770 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:56.840394 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:56.840770 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:56.840539 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:56.840770 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:56.840634 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:58.840046 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:58.839697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:25:58.840787 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:58.839716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:25:58.840787 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:58.840147 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:25:58.840787 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:58.839757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:25:58.840787 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:58.840219 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:25:58.840787 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:25:58.840264 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:25:58.995871 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:58.995835 2581 generic.go:356] "Generic (PLEG): container finished" podID="79ca6d29-ba35-4347-9237-4bcec72eafad" containerID="6371d5e4db99d4c308d2d4585907212ca05a24349881d32ead29d3593962ddd9" exitCode=0 Sep 09 02:25:58.996026 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:58.995896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerDied","Data":"6371d5e4db99d4c308d2d4585907212ca05a24349881d32ead29d3593962ddd9"} Sep 09 02:25:58.997945 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:58.997898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" event={"ID":"62eef3cd-26d0-428e-8de9-52ca6387d4b0","Type":"ContainerStarted","Data":"2ee658f4cefce00761c17d597e52e280154969240f49b4252cf58dd4511da7f9"} Sep 09 02:25:59.001244 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.001223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:25:59.001760 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.001738 2581 generic.go:356] "Generic (PLEG): container finished" podID="fb996e5e-da82-4f88-b07a-76bb575b4fc0" containerID="7e895af70489fdf0215b05ab95e8a779e3f1b6baf1748abfc8c8af2975968803" exitCode=1 Sep 09 02:25:59.001856 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.001784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"7d1ef1bce12035f7d29121615257957853c15be42251a083a0138579527a32c2"} Sep 09 02:25:59.001899 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.001866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"70065aba9235bd2fdfa7e04902d3e2485cea9174b18b9a1195f11977acedaa57"} Sep 09 02:25:59.001959 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.001915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"5675b1a6543bccbf56199168c68be953572ffa9513762a54cb4e549d41cae4c4"} Sep 09 02:25:59.002022 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.001981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"3765c98c8763d8d24561a2e8b2d2766fdeecf3a459ffc3bdf0bad012d6806b12"} Sep 09 02:25:59.002074 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.002037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerDied","Data":"7e895af70489fdf0215b05ab95e8a779e3f1b6baf1748abfc8c8af2975968803"} Sep 09 02:25:59.002119 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.002086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"86945efc42d85fa01bddc6eb17d057ebaebae00c4cd422453287d385d7f273ab"} Sep 09 02:25:59.003421 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.003395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mlxn4" event={"ID":"686fcff3-3baf-4ef1-85af-45b2e7e7adb1","Type":"ContainerStarted","Data":"97a4182af97fa534b6550a913b0e2c11321497659603b919819a064fdac0327a"} Sep 09 02:25:59.008101 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.008070 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" event={"ID":"f92ac1b31a30df9df346e8510b9d388a","Type":"ContainerStarted","Data":"19f6d13f2b82654ff69518a0b2b5c6638e6b9285fbd90dedb17adcf01940005f"} Sep 09 02:25:59.009807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.009720 2581 generic.go:356] "Generic (PLEG): container finished" podID="a72ae829bbdbcdbe438cd1ad052311c0" containerID="141ea0c325735e28991ff8b81ef8f6c28872a166817797be6725e238140474be" exitCode=0 Sep 09 02:25:59.009807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.009753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" event={"ID":"a72ae829bbdbcdbe438cd1ad052311c0","Type":"ContainerDied","Data":"141ea0c325735e28991ff8b81ef8f6c28872a166817797be6725e238140474be"} Sep 09 02:25:59.011864 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.011839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g9qkn" event={"ID":"56d510b0-0b49-430b-a072-bc536507030c","Type":"ContainerStarted","Data":"8124fd90c5da7f5deb16205e847640847a40d052a2858dc9ad8ae44ff38de3c3"} Sep 09 02:25:59.013632 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.013605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z5zrm" event={"ID":"1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568","Type":"ContainerStarted","Data":"45e13c70a82587b9bafb75792b9260062696990cec51dd0c6bbd3b267a34276b"} Sep 09 02:25:59.015320 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.015297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" event={"ID":"aa36722e-12c0-41c2-823b-75349e052322","Type":"ContainerStarted","Data":"2eab4b02a889c7c3ae1215e142826d6a891418bbd713980187b10ae164808476"} Sep 09 02:25:59.017563 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.017541 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z6swx" event={"ID":"c7895003-734d-42df-9e10-721e3742ac12","Type":"ContainerStarted","Data":"923135a0c5b325e18b798ac5b2da2e1a0843a9b5f45c66cfffd1a1fec07e64ed"} Sep 09 02:25:59.028787 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.028741 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mlxn4" podStartSLOduration=2.16449393 podStartE2EDuration="21.02872575s" totalImagesPullingTime="18.86423182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:25:59.028626236 +0000 UTC m=+21.690162309" watchObservedRunningTime="2026-09-09 02:25:59.02872575 +0000 UTC m=+21.690261824" Sep 09 02:25:59.046751 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.046702 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z5zrm" podStartSLOduration=2.2839179720000002 podStartE2EDuration="21.0466855s" totalImagesPullingTime="18.762767528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:25:59.046245086 +0000 UTC m=+21.707781161" watchObservedRunningTime="2026-09-09 02:25:59.0466855 +0000 UTC m=+21.708221578" Sep 09 02:25:59.075842 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.075771 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g9qkn" podStartSLOduration=2.198637614 podStartE2EDuration="21.0757523s" totalImagesPullingTime="18.877114686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:25:59.075535046 +0000 UTC m=+21.737071126" watchObservedRunningTime="2026-09-09 02:25:59.0757523 +0000 UTC m=+21.737288374" Sep 09 02:25:59.089978 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.089908 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-68.ec2.internal" podStartSLOduration=20.08988805 podStartE2EDuration="20.08988805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:25:59.089018056 +0000 UTC m=+21.750554132" watchObservedRunningTime="2026-09-09 02:25:59.08988805 +0000 UTC m=+21.751424127" Sep 09 02:25:59.121525 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.121484 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5lw7l" podStartSLOduration=2.237906602 podStartE2EDuration="21.121468211s" totalImagesPullingTime="18.883561609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:25:59.12104075 +0000 UTC m=+21.782576825" watchObservedRunningTime="2026-09-09 02:25:59.121468211 +0000 UTC m=+21.783004288" Sep 09 02:25:59.477009 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.476988 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 02:25:59.814693 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.814505 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T02:25:59.477005237Z","UUID":"6ce7b5b4-2bb3-48ec-97c8-f6afec393318","Handler":null,"Name":"","Endpoint":""} Sep 09 02:25:59.816143 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.816121 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 02:25:59.816285 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:25:59.816156 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 02:26:00.022319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.022243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" event={"ID":"a72ae829bbdbcdbe438cd1ad052311c0","Type":"ContainerStarted","Data":"3640a7fd09f93e8fc196c51b7fee40e2ed0b652c876c4d3e5a7b14ba283c8f4c"} Sep 09 02:26:00.024310 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.024280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dgjwg" event={"ID":"92def037-6cd7-46cc-a8d9-27bf0a4ff6dc","Type":"ContainerStarted","Data":"b8c5d8ac7e03124f6830664c946593167075d6ed42554fbd8c8afc10b8c23956"} Sep 09 02:26:00.026625 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.026597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" event={"ID":"62eef3cd-26d0-428e-8de9-52ca6387d4b0","Type":"ContainerStarted","Data":"b623b2223bda2b2fb21498fd093eca04afb454e0c8beeab9a5675862ae893167"} Sep 09 02:26:00.039488 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.039444 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-68.ec2.internal" podStartSLOduration=21.039427786 podStartE2EDuration="21.039427786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:00.038906014 +0000 UTC m=+22.700442090" watchObservedRunningTime="2026-09-09 02:26:00.039427786 +0000 UTC m=+22.700963861" Sep 09 02:26:00.039628 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.039556 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z6swx" podStartSLOduration=3.20770832 podStartE2EDuration="22.03954926s" totalImagesPullingTime="18.83184094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:25:59.137747159 +0000 UTC m=+21.799283232" watchObservedRunningTime="2026-09-09 02:26:00.03954926 +0000 UTC m=+22.701085334" Sep 09 02:26:00.055569 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.055525 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dgjwg" podStartSLOduration=3.262239772 podStartE2EDuration="22.055512345s" totalImagesPullingTime="18.793272573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:00.054728528 +0000 UTC m=+22.716264628" watchObservedRunningTime="2026-09-09 02:26:00.055512345 +0000 UTC m=+22.717048418" Sep 09 02:26:00.840222 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.840185 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:00.840222 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.840217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:00.840450 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:00.840226 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:00.840450 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:00.840322 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:26:00.840450 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:00.840397 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:26:00.840716 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:00.840517 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:26:01.032013 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:01.031911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" event={"ID":"62eef3cd-26d0-428e-8de9-52ca6387d4b0","Type":"ContainerStarted","Data":"df8f6db162bd26d689c9f7df0e04994d01a8ab7be2970810cb88db0664189115"} Sep 09 02:26:01.035602 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:01.035582 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:26:01.036070 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:01.036042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"7893d088fba80c25f28cd6e71fb617ba364070e3ec15308ed74f4d5745f26578"} Sep 09 02:26:01.049295 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:01.049251 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kq2fc" podStartSLOduration=2.535495019 podStartE2EDuration="23.049233623s" totalImagesPullingTime="20.513738604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:01.048037802 +0000 UTC m=+23.709573875" watchObservedRunningTime="2026-09-09 02:26:01.049233623 +0000 UTC m=+23.710769697" Sep 09 02:26:01.093156 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:01.093102 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:26:01.093777 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:01.093752 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:26:02.039004 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:02.038968 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:26:02.039636 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:02.039620 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z6swx" Sep 09 02:26:02.839760 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:02.839735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:02.839760 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:02.839759 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:02.839949 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:02.839845 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:02.839949 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:02.839853 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:26:02.839949 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:02.839914 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:26:02.840062 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:02.840029 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:26:03.046241 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.046175 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:26:03.046682 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.046595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"4163f5f9c7490c791b02fc79ec0f77bc3dacf9779bdeb5e984a668ffb0acc256"} Sep 09 02:26:03.047739 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.047713 2581 scope.go:117] "RemoveContainer" containerID="7e895af70489fdf0215b05ab95e8a779e3f1b6baf1748abfc8c8af2975968803" Sep 09 02:26:03.047860 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.047771 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:26:03.047915 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.047867 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:26:03.048717 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.048033 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:26:03.069125 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.068510 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:26:03.069125 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:03.068911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:26:04.054649 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.054619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:26:04.061308 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.057094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" event={"ID":"fb996e5e-da82-4f88-b07a-76bb575b4fc0","Type":"ContainerStarted","Data":"59c8be601d5e2bf84247720c55539f77fd9596647ef2443b5acfd9d5769eda2d"} Sep 09 02:26:04.086073 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.086018 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" podStartSLOduration=7.187441765 podStartE2EDuration="26.085997881s" totalImagesPullingTime="18.898556116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:04.08537676 +0000 UTC m=+26.746912834" watchObservedRunningTime="2026-09-09 02:26:04.085997881 +0000 UTC m=+26.747533954" Sep 09 02:26:04.733470 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.733437 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk762"] Sep 09 02:26:04.733654 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.733577 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:04.733714 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:04.733679 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:26:04.736220 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.736179 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6pdwv"] Sep 09 02:26:04.736577 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.736306 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:04.736577 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:04.736416 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:26:04.736764 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.736702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvgmh"] Sep 09 02:26:04.736823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:04.736796 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:04.736904 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:04.736872 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:26:05.840253 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:05.840222 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:05.840872 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:05.840345 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:26:06.063314 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:06.063280 2581 generic.go:356] "Generic (PLEG): container finished" podID="79ca6d29-ba35-4347-9237-4bcec72eafad" containerID="62732c1de95e9b35d30c6a0bf5bd57e88737750d0dabfaca2cef1bfda49087c7" exitCode=0 Sep 09 02:26:06.063473 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:06.063355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerDied","Data":"62732c1de95e9b35d30c6a0bf5bd57e88737750d0dabfaca2cef1bfda49087c7"} Sep 09 02:26:06.840429 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:06.840236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:06.840875 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:06.840235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:06.840875 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:06.840510 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:26:06.840875 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:06.840605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:26:07.840297 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:07.840263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:07.840446 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:07.840364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:26:08.070770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:08.070733 2581 generic.go:356] "Generic (PLEG): container finished" podID="79ca6d29-ba35-4347-9237-4bcec72eafad" containerID="110fe2f082a8b6993c6739ea5b93f514b347435e0eca000cc9d8343d89ea957e" exitCode=0 Sep 09 02:26:08.070978 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:08.070804 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerDied","Data":"110fe2f082a8b6993c6739ea5b93f514b347435e0eca000cc9d8343d89ea957e"} Sep 09 02:26:08.840087 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:08.840058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:08.840209 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:08.840146 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:26:08.840291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:08.840212 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:08.840346 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:08.840328 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:26:09.075978 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:09.075944 2581 generic.go:356] "Generic (PLEG): container finished" podID="79ca6d29-ba35-4347-9237-4bcec72eafad" containerID="05c4c6d85969d83e238dc82e2eb3b9c3845e53f73ee5b966d63fcf94738aa3df" exitCode=0 Sep 09 02:26:09.076359 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:09.076007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerDied","Data":"05c4c6d85969d83e238dc82e2eb3b9c3845e53f73ee5b966d63fcf94738aa3df"} Sep 09 02:26:09.839679 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:09.839647 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:09.839861 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:09.839781 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pdwv" podUID="78da3fd3-157b-4409-97a6-ba963de0e8f0" Sep 09 02:26:10.490206 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:10.490168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:10.490622 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.490325 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:10.490622 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.490400 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret podName:6e611bc0-3863-4aa4-a0fc-3271a812cf6e nodeName:}" failed. No retries permitted until 2026-09-09 02:26:42.490381255 +0000 UTC m=+65.151917325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret") pod "global-pull-secret-syncer-rvgmh" (UID: "6e611bc0-3863-4aa4-a0fc-3271a812cf6e") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:10.592952 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:10.591290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:10.592952 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.591467 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:10.592952 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.591539 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs podName:78da3fd3-157b-4409-97a6-ba963de0e8f0 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:42.591519097 +0000 UTC m=+65.253055170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs") pod "network-metrics-daemon-6pdwv" (UID: "78da3fd3-157b-4409-97a6-ba963de0e8f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:10.692545 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:10.692505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:10.692713 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.692654 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:26:10.692713 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.692682 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:26:10.692713 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.692693 2581 projected.go:196] Error preparing data for projected volume kube-api-access-76w2z for pod openshift-network-diagnostics/network-check-target-fk762: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:10.692888 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.692753 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z podName:e9262767-c90e-4484-925b-20f9e5752a21 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:42.692737627 +0000 UTC m=+65.354273684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-76w2z" (UniqueName: "kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z") pod "network-check-target-fk762" (UID: "e9262767-c90e-4484-925b-20f9e5752a21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:10.840191 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:10.840158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:10.840354 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:10.840157 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:10.840354 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.840265 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk762" podUID="e9262767-c90e-4484-925b-20f9e5752a21" Sep 09 02:26:10.840427 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:10.840354 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvgmh" podUID="6e611bc0-3863-4aa4-a0fc-3271a812cf6e" Sep 09 02:26:11.161813 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.161747 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-68.ec2.internal" event="NodeReady" Sep 09 02:26:11.161968 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.161883 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 02:26:11.208862 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.208834 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc7964c69-rdvt6"] Sep 09 02:26:11.210801 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.210773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.213660 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.213630 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 02:26:11.213822 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.213797 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5xmb7"] Sep 09 02:26:11.214124 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.214094 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 02:26:11.214353 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.214332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 02:26:11.214446 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.214381 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h655c\"" Sep 09 02:26:11.215627 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.215583 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v2rcg"] Sep 09 02:26:11.215735 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.215690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.217255 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.217237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.217990 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.217966 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 02:26:11.218160 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.218145 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 02:26:11.218988 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.218911 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t86xl\"" Sep 09 02:26:11.219177 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.219158 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 02:26:11.219413 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.219394 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 02:26:11.219655 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.219629 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 02:26:11.219859 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.219840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 02:26:11.220224 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.220205 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g2z42\"" Sep 09 02:26:11.225395 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.225024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v2rcg"] Sep 09 02:26:11.225630 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.225608 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc7964c69-rdvt6"] Sep 09 02:26:11.227972 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.227953 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xmb7"] Sep 09 02:26:11.298314 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-bound-sa-token\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.298498 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9df04-bb42-4217-b20d-d221562e2b90-tmp-dir\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.298498 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08640fee-7e97-42de-a96d-8fcefea8ff01-cert\") pod \"ingress-canary-v2rcg\" (UID: \"08640fee-7e97-42de-a96d-8fcefea8ff01\") " pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.298498 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-image-registry-private-configuration\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.298641 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-547tk\" (UniqueName: \"kubernetes.io/projected/08640fee-7e97-42de-a96d-8fcefea8ff01-kube-api-access-547tk\") pod \"ingress-canary-v2rcg\" (UID: \"08640fee-7e97-42de-a96d-8fcefea8ff01\") " pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.298641 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck7z6\" (UniqueName: \"kubernetes.io/projected/9af9df04-bb42-4217-b20d-d221562e2b90-kube-api-access-ck7z6\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.298641 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-installation-pull-secrets\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.298785 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-ca-trust-extracted\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.298785 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-trusted-ca\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.298785 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.298893 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-certificates\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.298893 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnqd\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-kube-api-access-jfnqd\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.299010 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.298979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.299010 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.299003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9af9df04-bb42-4217-b20d-d221562e2b90-config-volume\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.399567 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9df04-bb42-4217-b20d-d221562e2b90-tmp-dir\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.399567 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08640fee-7e97-42de-a96d-8fcefea8ff01-cert\") pod \"ingress-canary-v2rcg\" (UID: \"08640fee-7e97-42de-a96d-8fcefea8ff01\") " pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-image-registry-private-configuration\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-547tk\" (UniqueName: \"kubernetes.io/projected/08640fee-7e97-42de-a96d-8fcefea8ff01-kube-api-access-547tk\") pod \"ingress-canary-v2rcg\" (UID: \"08640fee-7e97-42de-a96d-8fcefea8ff01\") " pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7z6\" (UniqueName: \"kubernetes.io/projected/9af9df04-bb42-4217-b20d-d221562e2b90-kube-api-access-ck7z6\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-installation-pull-secrets\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-ca-trust-extracted\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-trusted-ca\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.399816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-certificates\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.400225 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnqd\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-kube-api-access-jfnqd\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.400225 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.400225 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9af9df04-bb42-4217-b20d-d221562e2b90-config-volume\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.400225 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-bound-sa-token\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.400225 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.399973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af9df04-bb42-4217-b20d-d221562e2b90-tmp-dir\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.400565 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.400544 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 02:26:11.400621 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.400566 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7964c69-rdvt6: secret "image-registry-tls" not found Sep 09 02:26:11.400669 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.400630 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls podName:1bd14b24-1c9c-4ded-9536-07ad17b7ae4b nodeName:}" failed. No retries permitted until 2026-09-09 02:26:11.900610855 +0000 UTC m=+34.562146910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls") pod "image-registry-fc7964c69-rdvt6" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b") : secret "image-registry-tls" not found Sep 09 02:26:11.401351 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.401326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-certificates\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.401447 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.401366 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-trusted-ca\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.401506 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.401482 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 02:26:11.401555 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.401531 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls podName:9af9df04-bb42-4217-b20d-d221562e2b90 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:11.901515299 +0000 UTC m=+34.563051351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls") pod "dns-default-5xmb7" (UID: "9af9df04-bb42-4217-b20d-d221562e2b90") : secret "dns-default-metrics-tls" not found Sep 09 02:26:11.401614 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.401591 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-ca-trust-extracted\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.402270 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.402245 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9af9df04-bb42-4217-b20d-d221562e2b90-config-volume\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.407652 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.407580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-image-registry-private-configuration\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.407652 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.407584 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-installation-pull-secrets\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.407652 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.407587 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08640fee-7e97-42de-a96d-8fcefea8ff01-cert\") pod \"ingress-canary-v2rcg\" (UID: \"08640fee-7e97-42de-a96d-8fcefea8ff01\") " pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.411280 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.411040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnqd\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-kube-api-access-jfnqd\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.412313 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.412238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-bound-sa-token\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.412313 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.412256 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck7z6\" (UniqueName: \"kubernetes.io/projected/9af9df04-bb42-4217-b20d-d221562e2b90-kube-api-access-ck7z6\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.412625 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.412608 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-547tk\" (UniqueName: \"kubernetes.io/projected/08640fee-7e97-42de-a96d-8fcefea8ff01-kube-api-access-547tk\") pod \"ingress-canary-v2rcg\" (UID: \"08640fee-7e97-42de-a96d-8fcefea8ff01\") " pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.538456 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.538424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v2rcg" Sep 09 02:26:11.821179 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.821149 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v2rcg"] Sep 09 02:26:11.839809 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.839765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:11.842256 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.842141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 02:26:11.842256 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.842241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swb8h\"" Sep 09 02:26:11.904492 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.904449 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:11.904655 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:11.904551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:11.904655 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.904621 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 02:26:11.904781 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.904681 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 02:26:11.904781 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.904697 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7964c69-rdvt6: secret "image-registry-tls" not found Sep 09 02:26:11.904781 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.904701 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls podName:9af9df04-bb42-4217-b20d-d221562e2b90 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:12.90467769 +0000 UTC m=+35.566213759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls") pod "dns-default-5xmb7" (UID: "9af9df04-bb42-4217-b20d-d221562e2b90") : secret "dns-default-metrics-tls" not found Sep 09 02:26:11.904781 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:11.904750 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls podName:1bd14b24-1c9c-4ded-9536-07ad17b7ae4b nodeName:}" failed. No retries permitted until 2026-09-09 02:26:12.904729372 +0000 UTC m=+35.566265428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls") pod "image-registry-fc7964c69-rdvt6" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b") : secret "image-registry-tls" not found Sep 09 02:26:12.840191 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.840159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:12.840191 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.840200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:12.844870 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.844834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 02:26:12.845034 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.844834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 02:26:12.845034 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.844916 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 02:26:12.845825 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.845808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2n6b\"" Sep 09 02:26:12.913748 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.913719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:12.913899 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:12.913773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:12.913899 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:12.913872 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 02:26:12.913899 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:12.913876 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 02:26:12.913899 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:12.913892 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7964c69-rdvt6: secret "image-registry-tls" not found Sep 09 02:26:12.914090 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:12.913949 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls podName:9af9df04-bb42-4217-b20d-d221562e2b90 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:14.913917865 +0000 UTC m=+37.575453917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls") pod "dns-default-5xmb7" (UID: "9af9df04-bb42-4217-b20d-d221562e2b90") : secret "dns-default-metrics-tls" not found Sep 09 02:26:12.914090 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:12.913962 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls podName:1bd14b24-1c9c-4ded-9536-07ad17b7ae4b nodeName:}" failed. No retries permitted until 2026-09-09 02:26:14.913956854 +0000 UTC m=+37.575492906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls") pod "image-registry-fc7964c69-rdvt6" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b") : secret "image-registry-tls" not found Sep 09 02:26:13.346318 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:13.346287 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08640fee_7e97_42de_a96d_8fcefea8ff01.slice/crio-23442e4989362ce05748d4e9a9101ebd1f87de111a0f856f183164320d95cd6b WatchSource:0}: Error finding container 23442e4989362ce05748d4e9a9101ebd1f87de111a0f856f183164320d95cd6b: Status 404 returned error can't find the container with id 23442e4989362ce05748d4e9a9101ebd1f87de111a0f856f183164320d95cd6b Sep 09 02:26:14.092285 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:14.092240 2581 generic.go:356] "Generic (PLEG): container finished" podID="79ca6d29-ba35-4347-9237-4bcec72eafad" containerID="0e6f86d90ba31f30b3f22a3549e6a15222813ecfc90e92f3a7c3ac6f06e54599" exitCode=0 Sep 09 02:26:14.093005 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:14.092328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerDied","Data":"0e6f86d90ba31f30b3f22a3549e6a15222813ecfc90e92f3a7c3ac6f06e54599"} Sep 09 02:26:14.094475 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:14.094445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v2rcg" event={"ID":"08640fee-7e97-42de-a96d-8fcefea8ff01","Type":"ContainerStarted","Data":"23442e4989362ce05748d4e9a9101ebd1f87de111a0f856f183164320d95cd6b"} Sep 09 02:26:14.930115 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:14.930080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:14.930367 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:14.930191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:14.930367 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:14.930257 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 02:26:14.930367 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:14.930292 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 02:26:14.930367 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:14.930303 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7964c69-rdvt6: secret "image-registry-tls" not found Sep 09 02:26:14.930367 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:14.930335 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls podName:9af9df04-bb42-4217-b20d-d221562e2b90 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:18.930314993 +0000 UTC m=+41.591851047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls") pod "dns-default-5xmb7" (UID: "9af9df04-bb42-4217-b20d-d221562e2b90") : secret "dns-default-metrics-tls" not found Sep 09 02:26:14.930367 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:14.930354 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls podName:1bd14b24-1c9c-4ded-9536-07ad17b7ae4b nodeName:}" failed. No retries permitted until 2026-09-09 02:26:18.930345402 +0000 UTC m=+41.591881453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls") pod "image-registry-fc7964c69-rdvt6" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b") : secret "image-registry-tls" not found Sep 09 02:26:15.104604 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:15.104569 2581 generic.go:356] "Generic (PLEG): container finished" podID="79ca6d29-ba35-4347-9237-4bcec72eafad" containerID="62265e65d52ea44b47dea1ea13c1e52a9e539f5b44fc0734d2e902c65a49f8f4" exitCode=0 Sep 09 02:26:15.105073 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:15.104630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerDied","Data":"62265e65d52ea44b47dea1ea13c1e52a9e539f5b44fc0734d2e902c65a49f8f4"} Sep 09 02:26:16.110864 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.110595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fgngj" event={"ID":"79ca6d29-ba35-4347-9237-4bcec72eafad","Type":"ContainerStarted","Data":"b1b337bbdbf24031eb3395f4430aba83b0e33120047917cd885abff92f42a73a"} Sep 09 02:26:16.134028 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.133982 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fgngj" podStartSLOduration=10.844450867 podStartE2EDuration="38.133967004s" totalImagesPullingTime="27.289516137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:16.132806693 +0000 UTC m=+38.794342794" watchObservedRunningTime="2026-09-09 02:26:16.133967004 +0000 UTC m=+38.795503078" Sep 09 02:26:16.561293 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.561217 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-whgkj"] Sep 09 02:26:16.578629 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.578596 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-whgkj"] Sep 09 02:26:16.578766 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.578725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.599607 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.599555 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 02:26:16.599607 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.599577 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 02:26:16.599770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.599557 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 02:26:16.599770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.599557 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 02:26:16.599770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.599724 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8wjcz\"" Sep 09 02:26:16.743710 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.743672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71d4e732-bca1-411a-8d67-9a20a788cef9-crio-socket\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.743891 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.743730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qds5\" (UniqueName: \"kubernetes.io/projected/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-api-access-7qds5\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.743891 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.743778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.743891 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.743822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.743891 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.743866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71d4e732-bca1-411a-8d67-9a20a788cef9-data-volume\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.817996 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.817966 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm"] Sep 09 02:26:16.838399 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.838368 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm"] Sep 09 02:26:16.838541 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.838491 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" Sep 09 02:26:16.840747 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.840723 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 02:26:16.840747 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.840740 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pd949\"" Sep 09 02:26:16.840977 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.840790 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 02:26:16.844648 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.844620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71d4e732-bca1-411a-8d67-9a20a788cef9-crio-socket\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.844760 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.844655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qds5\" (UniqueName: \"kubernetes.io/projected/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-api-access-7qds5\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.844760 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.844696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.844760 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.844739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.844884 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.844761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71d4e732-bca1-411a-8d67-9a20a788cef9-data-volume\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.844955 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.844891 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71d4e732-bca1-411a-8d67-9a20a788cef9-crio-socket\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.845334 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:16.844980 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 02:26:16.845334 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:16.845046 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:17.345024855 +0000 UTC m=+40.006560928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : configmap "kube-rbac-proxy" not found Sep 09 02:26:16.845334 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:16.845054 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 02:26:16.845334 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:16.845117 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:17.345100425 +0000 UTC m=+40.006636477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : secret "insights-runtime-extractor-tls" not found Sep 09 02:26:16.845334 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.845139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71d4e732-bca1-411a-8d67-9a20a788cef9-data-volume\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.861985 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.861957 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qds5\" (UniqueName: \"kubernetes.io/projected/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-api-access-7qds5\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:16.948452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:16.945973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9dg7\" (UniqueName: \"kubernetes.io/projected/f42167a1-48ec-40c4-bed3-19d2ebe68786-kube-api-access-n9dg7\") pod \"migrator-fdbb8fdff-d5cfm\" (UID: \"f42167a1-48ec-40c4-bed3-19d2ebe68786\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" Sep 09 02:26:17.047073 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.047038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9dg7\" (UniqueName: \"kubernetes.io/projected/f42167a1-48ec-40c4-bed3-19d2ebe68786-kube-api-access-n9dg7\") pod \"migrator-fdbb8fdff-d5cfm\" (UID: \"f42167a1-48ec-40c4-bed3-19d2ebe68786\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" Sep 09 02:26:17.054371 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.054340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9dg7\" (UniqueName: \"kubernetes.io/projected/f42167a1-48ec-40c4-bed3-19d2ebe68786-kube-api-access-n9dg7\") pod \"migrator-fdbb8fdff-d5cfm\" (UID: \"f42167a1-48ec-40c4-bed3-19d2ebe68786\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" Sep 09 02:26:17.114455 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.114368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v2rcg" event={"ID":"08640fee-7e97-42de-a96d-8fcefea8ff01","Type":"ContainerStarted","Data":"0755cd8328a1a006bb4ff50aedf04cbebae828cb09db50d6414ab9523e2ac6ec"} Sep 09 02:26:17.129199 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.129147 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v2rcg" podStartSLOduration=3.354594628 podStartE2EDuration="6.129130091s" totalImagesPullingTime="2.774535463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:17.128521692 +0000 UTC m=+39.790057766" watchObservedRunningTime="2026-09-09 02:26:17.129130091 +0000 UTC m=+39.790666184" Sep 09 02:26:17.147757 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.147731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" Sep 09 02:26:17.350218 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.350166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:17.350427 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.350295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:17.350427 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:17.350334 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 02:26:17.350427 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:17.350378 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 02:26:17.350427 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:17.350422 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:18.350401659 +0000 UTC m=+41.011937713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : secret "insights-runtime-extractor-tls" not found Sep 09 02:26:17.350643 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:17.350442 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:18.350432359 +0000 UTC m=+41.011968411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : configmap "kube-rbac-proxy" not found Sep 09 02:26:17.432371 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:17.432303 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm"] Sep 09 02:26:17.435319 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:17.435293 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42167a1_48ec_40c4_bed3_19d2ebe68786.slice/crio-cdb4c5890687639ad938530f77fc49d92e71b20d7bb6833c4022a255e5ae3fbd WatchSource:0}: Error finding container cdb4c5890687639ad938530f77fc49d92e71b20d7bb6833c4022a255e5ae3fbd: Status 404 returned error can't find the container with id cdb4c5890687639ad938530f77fc49d92e71b20d7bb6833c4022a255e5ae3fbd Sep 09 02:26:18.118154 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:18.118105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" event={"ID":"f42167a1-48ec-40c4-bed3-19d2ebe68786","Type":"ContainerStarted","Data":"cdb4c5890687639ad938530f77fc49d92e71b20d7bb6833c4022a255e5ae3fbd"} Sep 09 02:26:18.132400 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:18.132375 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mlxn4_686fcff3-3baf-4ef1-85af-45b2e7e7adb1/dns-node-resolver/0.log" Sep 09 02:26:18.356153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:18.356115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:18.356335 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:18.356181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:18.356335 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.356251 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 02:26:18.356436 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.356336 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:20.356311805 +0000 UTC m=+43.017847879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : configmap "kube-rbac-proxy" not found Sep 09 02:26:18.356436 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.356377 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 02:26:18.356524 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.356438 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:20.356419822 +0000 UTC m=+43.017955877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : secret "insights-runtime-extractor-tls" not found Sep 09 02:26:18.961897 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:18.961858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:18.962097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:18.961938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:18.962097 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.962025 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 02:26:18.962097 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.962045 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 02:26:18.962097 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.962069 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7964c69-rdvt6: secret "image-registry-tls" not found Sep 09 02:26:18.962292 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.962071 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls podName:9af9df04-bb42-4217-b20d-d221562e2b90 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:26.962057317 +0000 UTC m=+49.623593370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls") pod "dns-default-5xmb7" (UID: "9af9df04-bb42-4217-b20d-d221562e2b90") : secret "dns-default-metrics-tls" not found Sep 09 02:26:18.962292 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:18.962209 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls podName:1bd14b24-1c9c-4ded-9536-07ad17b7ae4b nodeName:}" failed. No retries permitted until 2026-09-09 02:26:26.962191401 +0000 UTC m=+49.623727455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls") pod "image-registry-fc7964c69-rdvt6" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b") : secret "image-registry-tls" not found Sep 09 02:26:19.121985 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.121954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" event={"ID":"f42167a1-48ec-40c4-bed3-19d2ebe68786","Type":"ContainerStarted","Data":"04ff8bebb1dbf213bcb509e6a9683443e448eb1699335cef977881d67ed09809"} Sep 09 02:26:19.331813 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.331784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z5zrm_1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568/node-ca/0.log" Sep 09 02:26:19.532815 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.532727 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c6trr"] Sep 09 02:26:19.556397 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.556369 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c6trr"] Sep 09 02:26:19.556542 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.556485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:19.558873 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.558841 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 09 02:26:19.559044 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.558942 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hv4vq\"" Sep 09 02:26:19.559044 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.558973 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 09 02:26:19.667822 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.667793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:19.668012 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.667850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-nginx-conf\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:19.768452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.768417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:19.768604 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.768478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-nginx-conf\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:19.768668 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:19.768654 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 02:26:19.768727 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:19.768717 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert podName:b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:20.268698718 +0000 UTC m=+42.930234787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c6trr" (UID: "b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6") : secret "networking-console-plugin-cert" not found Sep 09 02:26:19.769145 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.769125 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-nginx-conf\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:19.795404 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.795298 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8n2w7"] Sep 09 02:26:19.820410 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.820382 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8n2w7"] Sep 09 02:26:19.820546 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.820473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:19.822958 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.822932 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gks85\"" Sep 09 02:26:19.823078 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.823005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 09 02:26:19.823078 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.823010 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 09 02:26:19.823203 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.823005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 09 02:26:19.823203 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.823087 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 09 02:26:19.931933 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.931906 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v2rcg_08640fee-7e97-42de-a96d-8fcefea8ff01/serve-healthcheck-canary/0.log" Sep 09 02:26:19.970352 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.970330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3101eb6-100e-4a54-b25d-77da445c5b3e-signing-cabundle\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:19.970458 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.970372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8sz\" (UniqueName: \"kubernetes.io/projected/d3101eb6-100e-4a54-b25d-77da445c5b3e-kube-api-access-7t8sz\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:19.970458 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:19.970439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3101eb6-100e-4a54-b25d-77da445c5b3e-signing-key\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.071481 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.071451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3101eb6-100e-4a54-b25d-77da445c5b3e-signing-cabundle\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.071611 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.071496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8sz\" (UniqueName: \"kubernetes.io/projected/d3101eb6-100e-4a54-b25d-77da445c5b3e-kube-api-access-7t8sz\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.071611 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.071529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3101eb6-100e-4a54-b25d-77da445c5b3e-signing-key\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.072205 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.072184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3101eb6-100e-4a54-b25d-77da445c5b3e-signing-cabundle\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.073902 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.073885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3101eb6-100e-4a54-b25d-77da445c5b3e-signing-key\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.078936 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.078906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8sz\" (UniqueName: \"kubernetes.io/projected/d3101eb6-100e-4a54-b25d-77da445c5b3e-kube-api-access-7t8sz\") pod \"service-ca-75d99c484-8n2w7\" (UID: \"d3101eb6-100e-4a54-b25d-77da445c5b3e\") " pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.126436 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.126403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" event={"ID":"f42167a1-48ec-40c4-bed3-19d2ebe68786","Type":"ContainerStarted","Data":"01dc0ce29a8d2a2bad16d71f7a03526616e033333fe212edf443045c5202ba68"} Sep 09 02:26:20.128817 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.128799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-8n2w7" Sep 09 02:26:20.140319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.140275 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-d5cfm" podStartSLOduration=2.5903426290000002 podStartE2EDuration="4.14025514s" totalImagesPullingTime="1.549912511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:20.139805594 +0000 UTC m=+42.801341669" watchObservedRunningTime="2026-09-09 02:26:20.14025514 +0000 UTC m=+42.801791267" Sep 09 02:26:20.274003 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.273971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:20.274172 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:20.274147 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 02:26:20.274243 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:20.274230 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert podName:b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:21.274212059 +0000 UTC m=+43.935748136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c6trr" (UID: "b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6") : secret "networking-console-plugin-cert" not found Sep 09 02:26:20.375563 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.375472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:20.375563 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.375523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:20.375734 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:20.375606 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 02:26:20.375734 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:20.375624 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 02:26:20.375734 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:20.375673 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:24.375660773 +0000 UTC m=+47.037196824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : secret "insights-runtime-extractor-tls" not found Sep 09 02:26:20.375734 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:20.375687 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:24.375679806 +0000 UTC m=+47.037215858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : configmap "kube-rbac-proxy" not found Sep 09 02:26:20.414217 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:20.414142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-8n2w7"] Sep 09 02:26:20.417700 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:20.417672 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3101eb6_100e_4a54_b25d_77da445c5b3e.slice/crio-d8dc7dceddcea1a3e095feaa6bcb0fc40d0d6dd35dd428f40a51c05354df7818 WatchSource:0}: Error finding container d8dc7dceddcea1a3e095feaa6bcb0fc40d0d6dd35dd428f40a51c05354df7818: Status 404 returned error can't find the container with id d8dc7dceddcea1a3e095feaa6bcb0fc40d0d6dd35dd428f40a51c05354df7818 Sep 09 02:26:21.130540 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:21.130494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-8n2w7" event={"ID":"d3101eb6-100e-4a54-b25d-77da445c5b3e","Type":"ContainerStarted","Data":"d8dc7dceddcea1a3e095feaa6bcb0fc40d0d6dd35dd428f40a51c05354df7818"} Sep 09 02:26:21.283390 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:21.283350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:21.283594 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:21.283478 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 02:26:21.283594 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:21.283559 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert podName:b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:23.283536104 +0000 UTC m=+45.945072177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c6trr" (UID: "b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6") : secret "networking-console-plugin-cert" not found Sep 09 02:26:23.136979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:23.136943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-8n2w7" event={"ID":"d3101eb6-100e-4a54-b25d-77da445c5b3e","Type":"ContainerStarted","Data":"4174dae44d686cd4de62f36eec6f4049fb1f5490243772d72a06a9f7034492d0"} Sep 09 02:26:23.152941 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:23.152878 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-8n2w7" podStartSLOduration=1.7827330510000001 podStartE2EDuration="4.152860838s" totalImagesPullingTime="2.370127787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:23.151964343 +0000 UTC m=+45.813500418" watchObservedRunningTime="2026-09-09 02:26:23.152860838 +0000 UTC m=+45.814396943" Sep 09 02:26:23.301299 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:23.301263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:23.301471 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:23.301437 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 02:26:23.301517 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:23.301511 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert podName:b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:27.301490695 +0000 UTC m=+49.963026748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c6trr" (UID: "b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6") : secret "networking-console-plugin-cert" not found Sep 09 02:26:24.411283 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:24.411241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:24.411634 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:24.411304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:24.411634 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:24.411471 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 02:26:24.411634 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:24.411537 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls podName:71d4e732-bca1-411a-8d67-9a20a788cef9 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:32.411521775 +0000 UTC m=+55.073057827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-whgkj" (UID: "71d4e732-bca1-411a-8d67-9a20a788cef9") : secret "insights-runtime-extractor-tls" not found Sep 09 02:26:24.411832 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:24.411814 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71d4e732-bca1-411a-8d67-9a20a788cef9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:27.035828 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:27.035784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") pod \"image-registry-fc7964c69-rdvt6\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:27.036445 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:27.035871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:27.036445 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:27.035996 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 02:26:27.036445 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:27.036022 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 02:26:27.036445 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:27.036025 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7964c69-rdvt6: secret "image-registry-tls" not found Sep 09 02:26:27.036445 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:27.036087 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls podName:9af9df04-bb42-4217-b20d-d221562e2b90 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:43.036070768 +0000 UTC m=+65.697606825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls") pod "dns-default-5xmb7" (UID: "9af9df04-bb42-4217-b20d-d221562e2b90") : secret "dns-default-metrics-tls" not found Sep 09 02:26:27.036445 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:27.036110 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls podName:1bd14b24-1c9c-4ded-9536-07ad17b7ae4b nodeName:}" failed. No retries permitted until 2026-09-09 02:26:43.03609594 +0000 UTC m=+65.697631992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls") pod "image-registry-fc7964c69-rdvt6" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b") : secret "image-registry-tls" not found Sep 09 02:26:27.338914 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:27.338873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:27.339093 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:27.339022 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 09 02:26:27.339093 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:27.339087 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert podName:b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:35.339071624 +0000 UTC m=+58.000607676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c6trr" (UID: "b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6") : secret "networking-console-plugin-cert" not found Sep 09 02:26:32.476596 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:32.476549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:32.478882 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:32.478857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71d4e732-bca1-411a-8d67-9a20a788cef9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-whgkj\" (UID: \"71d4e732-bca1-411a-8d67-9a20a788cef9\") " pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:32.487769 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:32.487745 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-whgkj" Sep 09 02:26:32.757417 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:32.757341 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-whgkj"] Sep 09 02:26:32.760176 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:32.760141 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d4e732_bca1_411a_8d67_9a20a788cef9.slice/crio-4745a49ba6c791536c4ffce188b44d04e6cda984abbc08db9f74f0793768c1bf WatchSource:0}: Error finding container 4745a49ba6c791536c4ffce188b44d04e6cda984abbc08db9f74f0793768c1bf: Status 404 returned error can't find the container with id 4745a49ba6c791536c4ffce188b44d04e6cda984abbc08db9f74f0793768c1bf Sep 09 02:26:33.166209 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:33.166176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whgkj" event={"ID":"71d4e732-bca1-411a-8d67-9a20a788cef9","Type":"ContainerStarted","Data":"ad2123c7719d81da8f20433d2c78bc6eb75e23267c4c5c0bbce3ec798e839024"} Sep 09 02:26:33.166371 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:33.166232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whgkj" event={"ID":"71d4e732-bca1-411a-8d67-9a20a788cef9","Type":"ContainerStarted","Data":"4745a49ba6c791536c4ffce188b44d04e6cda984abbc08db9f74f0793768c1bf"} Sep 09 02:26:34.172917 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:34.172875 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whgkj" event={"ID":"71d4e732-bca1-411a-8d67-9a20a788cef9","Type":"ContainerStarted","Data":"f1a331ec9d22f6704808c9b12ae42a7bf96a8192558198ee1adf54eb2871fb34"} Sep 09 02:26:35.076814 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:35.076784 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gzpmf" Sep 09 02:26:35.400588 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:35.400549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:35.402917 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:35.402896 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c6trr\" (UID: \"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:35.465425 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:35.465391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" Sep 09 02:26:35.742616 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:35.742533 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c6trr"] Sep 09 02:26:35.746464 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:35.746436 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb985b8b5_56ba_48dd_bb38_e8d3f0f2f4d6.slice/crio-7b0027fa46261c45d125f114aa8a06d45043c8f9441018c7e331f0df87689842 WatchSource:0}: Error finding container 7b0027fa46261c45d125f114aa8a06d45043c8f9441018c7e331f0df87689842: Status 404 returned error can't find the container with id 7b0027fa46261c45d125f114aa8a06d45043c8f9441018c7e331f0df87689842 Sep 09 02:26:36.180623 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:36.180581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" event={"ID":"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6","Type":"ContainerStarted","Data":"7b0027fa46261c45d125f114aa8a06d45043c8f9441018c7e331f0df87689842"} Sep 09 02:26:36.182578 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:36.182551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-whgkj" event={"ID":"71d4e732-bca1-411a-8d67-9a20a788cef9","Type":"ContainerStarted","Data":"442ed5aab66372dc091c3e68eeeed75124e434e76fcdaf56e5207c79349f5a7f"} Sep 09 02:26:36.199604 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:36.199560 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-whgkj" podStartSLOduration=17.826587138 podStartE2EDuration="20.199544706s" totalImagesPullingTime="2.372957568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:26:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:36.198532626 +0000 UTC m=+58.860068700" watchObservedRunningTime="2026-09-09 02:26:36.199544706 +0000 UTC m=+58.861080780" Sep 09 02:26:37.187837 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:37.187740 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" event={"ID":"b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6","Type":"ContainerStarted","Data":"75805f6dfeeb1fda7423aa704b6c4190f98ea6c4d8812410fac14d0888854c1c"} Sep 09 02:26:37.201675 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:37.201629 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-c6trr" podStartSLOduration=17.086047108 podStartE2EDuration="18.201614607s" totalImagesPullingTime="1.115567499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:37.200902167 +0000 UTC m=+59.862438254" watchObservedRunningTime="2026-09-09 02:26:37.201614607 +0000 UTC m=+59.863150680" Sep 09 02:26:41.005529 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.005493 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm"] Sep 09 02:26:41.007933 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.007909 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.009847 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.009823 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm"] Sep 09 02:26:41.010280 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.010262 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 02:26:41.011222 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.011202 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 02:26:41.011319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.011223 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-llh2g\"" Sep 09 02:26:41.011319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.011241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 09 02:26:41.011319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.011209 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 02:26:41.011483 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.011468 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.013429 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.013410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 02:26:41.013587 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.013564 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 02:26:41.014176 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.014158 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 02:26:41.014558 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.014541 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc7964c69-rdvt6"] Sep 09 02:26:41.014733 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:41.014713 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" podUID="1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" Sep 09 02:26:41.014954 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.014938 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 02:26:41.019877 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.019859 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm"] Sep 09 02:26:41.026003 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.025984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm"] Sep 09 02:26:41.048058 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjln7\" (UniqueName: \"kubernetes.io/projected/5d7cece7-cb40-4dd1-99e1-00c04e141580-kube-api-access-bjln7\") pod \"managed-serviceaccount-addon-agent-957459556-vfdhm\" (UID: \"5d7cece7-cb40-4dd1-99e1-00c04e141580\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.048155 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-hub\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.048155 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/23d0c474-d3fa-4883-9d60-132972c71c0c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.048155 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbrbl\" (UniqueName: \"kubernetes.io/projected/23d0c474-d3fa-4883-9d60-132972c71c0c-kube-api-access-wbrbl\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.048256 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.048304 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-ca\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.048352 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.048398 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.048371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d7cece7-cb40-4dd1-99e1-00c04e141580-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-957459556-vfdhm\" (UID: \"5d7cece7-cb40-4dd1-99e1-00c04e141580\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.111787 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.111758 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bb9b4867d-wpcvr"] Sep 09 02:26:41.113617 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.113601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.136285 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.136262 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb9b4867d-wpcvr"] Sep 09 02:26:41.148911 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.148888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/772387c8-9523-4bb1-889e-7f1c26dd811e-installation-pull-secrets\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.149030 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.148934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-bound-sa-token\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.149030 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.148966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-226l9\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-kube-api-access-226l9\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.149030 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.148994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-ca\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.149135 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.149135 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/772387c8-9523-4bb1-889e-7f1c26dd811e-ca-trust-extracted\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.149196 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-registry-tls\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.149231 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d7cece7-cb40-4dd1-99e1-00c04e141580-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-957459556-vfdhm\" (UID: \"5d7cece7-cb40-4dd1-99e1-00c04e141580\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.149265 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772387c8-9523-4bb1-889e-7f1c26dd811e-trusted-ca\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.149300 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjln7\" (UniqueName: \"kubernetes.io/projected/5d7cece7-cb40-4dd1-99e1-00c04e141580-kube-api-access-bjln7\") pod \"managed-serviceaccount-addon-agent-957459556-vfdhm\" (UID: \"5d7cece7-cb40-4dd1-99e1-00c04e141580\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.149343 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-hub\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.149395 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/23d0c474-d3fa-4883-9d60-132972c71c0c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.149395 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbrbl\" (UniqueName: \"kubernetes.io/projected/23d0c474-d3fa-4883-9d60-132972c71c0c-kube-api-access-wbrbl\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.149506 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/772387c8-9523-4bb1-889e-7f1c26dd811e-registry-certificates\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.149645 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.149645 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.149617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/772387c8-9523-4bb1-889e-7f1c26dd811e-image-registry-private-configuration\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.150232 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.150207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/23d0c474-d3fa-4883-9d60-132972c71c0c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.151768 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.151745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.151863 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.151792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-hub\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.151978 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.151959 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-ca\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.152228 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.152211 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23d0c474-d3fa-4883-9d60-132972c71c0c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.152273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.152235 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d7cece7-cb40-4dd1-99e1-00c04e141580-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-957459556-vfdhm\" (UID: \"5d7cece7-cb40-4dd1-99e1-00c04e141580\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.164230 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.164206 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbrbl\" (UniqueName: \"kubernetes.io/projected/23d0c474-d3fa-4883-9d60-132972c71c0c-kube-api-access-wbrbl\") pod \"cluster-proxy-proxy-agent-754f887b6d-nt9fm\" (UID: \"23d0c474-d3fa-4883-9d60-132972c71c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.164538 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.164520 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjln7\" (UniqueName: \"kubernetes.io/projected/5d7cece7-cb40-4dd1-99e1-00c04e141580-kube-api-access-bjln7\") pod \"managed-serviceaccount-addon-agent-957459556-vfdhm\" (UID: \"5d7cece7-cb40-4dd1-99e1-00c04e141580\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.199871 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.199843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:41.206013 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.205992 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:41.249890 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.249863 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-trusted-ca\") pod \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " Sep 09 02:26:41.250094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.249905 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfnqd\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-kube-api-access-jfnqd\") pod \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " Sep 09 02:26:41.250094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.249957 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-certificates\") pod \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " Sep 09 02:26:41.250094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250062 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-image-registry-private-configuration\") pod \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " Sep 09 02:26:41.250259 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250105 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-installation-pull-secrets\") pod \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " Sep 09 02:26:41.250259 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250129 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-bound-sa-token\") pod \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " Sep 09 02:26:41.250259 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250154 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-ca-trust-extracted\") pod \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\" (UID: \"1bd14b24-1c9c-4ded-9536-07ad17b7ae4b\") " Sep 09 02:26:41.250416 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/772387c8-9523-4bb1-889e-7f1c26dd811e-ca-trust-extracted\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250416 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-registry-tls\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250416 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250312 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:26:41.250416 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772387c8-9523-4bb1-889e-7f1c26dd811e-trusted-ca\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250416 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250364 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:26:41.250655 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/772387c8-9523-4bb1-889e-7f1c26dd811e-registry-certificates\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250655 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250569 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:26:41.250655 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/772387c8-9523-4bb1-889e-7f1c26dd811e-image-registry-private-configuration\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/772387c8-9523-4bb1-889e-7f1c26dd811e-installation-pull-secrets\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-bound-sa-token\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-226l9\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-kube-api-access-226l9\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.250807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250773 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-trusted-ca\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:41.250807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250790 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-certificates\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:41.250807 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250806 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-ca-trust-extracted\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:41.252059 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.250880 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/772387c8-9523-4bb1-889e-7f1c26dd811e-ca-trust-extracted\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.252059 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.251580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/772387c8-9523-4bb1-889e-7f1c26dd811e-registry-certificates\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.252059 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.251830 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772387c8-9523-4bb1-889e-7f1c26dd811e-trusted-ca\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.252901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.252862 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-kube-api-access-jfnqd" (OuterVolumeSpecName: "kube-api-access-jfnqd") pod "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b"). InnerVolumeSpecName "kube-api-access-jfnqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:26:41.252901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.252866 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:26:41.253101 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.252953 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:26:41.253101 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.253021 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" (UID: "1bd14b24-1c9c-4ded-9536-07ad17b7ae4b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:26:41.253595 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.253566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/772387c8-9523-4bb1-889e-7f1c26dd811e-installation-pull-secrets\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.253698 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.253616 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/772387c8-9523-4bb1-889e-7f1c26dd811e-image-registry-private-configuration\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.254180 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.254160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-registry-tls\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.266058 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.266034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-226l9\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-kube-api-access-226l9\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.266141 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.266091 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772387c8-9523-4bb1-889e-7f1c26dd811e-bound-sa-token\") pod \"image-registry-bb9b4867d-wpcvr\" (UID: \"772387c8-9523-4bb1-889e-7f1c26dd811e\") " pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.330378 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.330349 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" Sep 09 02:26:41.335757 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.335734 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" Sep 09 02:26:41.351661 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.351637 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfnqd\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-kube-api-access-jfnqd\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:41.351749 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.351665 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-image-registry-private-configuration\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:41.351749 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.351679 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-installation-pull-secrets\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:41.351749 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.351691 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-bound-sa-token\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:41.434559 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.434511 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h655c\"" Sep 09 02:26:41.442361 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.442342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:41.598788 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.598754 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm"] Sep 09 02:26:41.602143 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:41.602112 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d7cece7_cb40_4dd1_99e1_00c04e141580.slice/crio-c410dc826ed9ec121c28a769b2841c86ab848c3af49a407e0cf98295a0cf9dfe WatchSource:0}: Error finding container c410dc826ed9ec121c28a769b2841c86ab848c3af49a407e0cf98295a0cf9dfe: Status 404 returned error can't find the container with id c410dc826ed9ec121c28a769b2841c86ab848c3af49a407e0cf98295a0cf9dfe Sep 09 02:26:41.618709 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.618682 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm"] Sep 09 02:26:41.621773 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:41.621752 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23d0c474_d3fa_4883_9d60_132972c71c0c.slice/crio-effec1241ce5d9b1021cd96050eed6f4abe014de377bfc270639c2c5308c38a2 WatchSource:0}: Error finding container effec1241ce5d9b1021cd96050eed6f4abe014de377bfc270639c2c5308c38a2: Status 404 returned error can't find the container with id effec1241ce5d9b1021cd96050eed6f4abe014de377bfc270639c2c5308c38a2 Sep 09 02:26:41.714772 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:41.714739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb9b4867d-wpcvr"] Sep 09 02:26:41.717412 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:41.717387 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772387c8_9523_4bb1_889e_7f1c26dd811e.slice/crio-bec530bb98d452cf8b292e0126641f80f300d59abec3f379997985131d6139ee WatchSource:0}: Error finding container bec530bb98d452cf8b292e0126641f80f300d59abec3f379997985131d6139ee: Status 404 returned error can't find the container with id bec530bb98d452cf8b292e0126641f80f300d59abec3f379997985131d6139ee Sep 09 02:26:42.204339 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.204236 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" event={"ID":"5d7cece7-cb40-4dd1-99e1-00c04e141580","Type":"ContainerStarted","Data":"c410dc826ed9ec121c28a769b2841c86ab848c3af49a407e0cf98295a0cf9dfe"} Sep 09 02:26:42.205748 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.205726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" event={"ID":"772387c8-9523-4bb1-889e-7f1c26dd811e","Type":"ContainerStarted","Data":"482cacf83a767a3244f2adb12f14da83038943bea1525d5fa2173904c4ea893a"} Sep 09 02:26:42.205855 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.205765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" event={"ID":"772387c8-9523-4bb1-889e-7f1c26dd811e","Type":"ContainerStarted","Data":"bec530bb98d452cf8b292e0126641f80f300d59abec3f379997985131d6139ee"} Sep 09 02:26:42.205855 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.205807 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:26:42.206911 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.206895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7964c69-rdvt6" Sep 09 02:26:42.207021 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.206941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" event={"ID":"23d0c474-d3fa-4883-9d60-132972c71c0c","Type":"ContainerStarted","Data":"effec1241ce5d9b1021cd96050eed6f4abe014de377bfc270639c2c5308c38a2"} Sep 09 02:26:42.224476 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.224433 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" podStartSLOduration=1.224417173 podStartE2EDuration="1.224417173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:42.223579368 +0000 UTC m=+64.885115443" watchObservedRunningTime="2026-09-09 02:26:42.224417173 +0000 UTC m=+64.885953248" Sep 09 02:26:42.249545 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.249518 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc7964c69-rdvt6"] Sep 09 02:26:42.253546 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.253513 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fc7964c69-rdvt6"] Sep 09 02:26:42.360294 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.360258 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b-registry-tls\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:26:42.561960 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.561846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:42.564159 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.564141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 02:26:42.575172 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.575140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e611bc0-3863-4aa4-a0fc-3271a812cf6e-original-pull-secret\") pod \"global-pull-secret-syncer-rvgmh\" (UID: \"6e611bc0-3863-4aa4-a0fc-3271a812cf6e\") " pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:42.662685 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.662652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:42.664937 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.664897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 02:26:42.676512 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.676480 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da3fd3-157b-4409-97a6-ba963de0e8f0-metrics-certs\") pod \"network-metrics-daemon-6pdwv\" (UID: \"78da3fd3-157b-4409-97a6-ba963de0e8f0\") " pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:42.751832 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.751789 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swb8h\"" Sep 09 02:26:42.759784 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.759756 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pdwv" Sep 09 02:26:42.763411 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.763100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:42.765668 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.765641 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 02:26:42.777230 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.777199 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 02:26:42.788010 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.787980 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76w2z\" (UniqueName: \"kubernetes.io/projected/e9262767-c90e-4484-925b-20f9e5752a21-kube-api-access-76w2z\") pod \"network-check-target-fk762\" (UID: \"e9262767-c90e-4484-925b-20f9e5752a21\") " pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:42.856934 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.856884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2n6b\"" Sep 09 02:26:42.859114 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.859088 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvgmh" Sep 09 02:26:42.864944 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:42.864767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:43.047821 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.047780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6pdwv"] Sep 09 02:26:43.051721 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:43.051679 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78da3fd3_157b_4409_97a6_ba963de0e8f0.slice/crio-d7d5404ddb2596712592d6cf1c21d2830f7732e6eb27ea2086cb6be1ed5f520a WatchSource:0}: Error finding container d7d5404ddb2596712592d6cf1c21d2830f7732e6eb27ea2086cb6be1ed5f520a: Status 404 returned error can't find the container with id d7d5404ddb2596712592d6cf1c21d2830f7732e6eb27ea2086cb6be1ed5f520a Sep 09 02:26:43.067010 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.066629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:43.075299 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.075186 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9af9df04-bb42-4217-b20d-d221562e2b90-metrics-tls\") pod \"dns-default-5xmb7\" (UID: \"9af9df04-bb42-4217-b20d-d221562e2b90\") " pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:43.165146 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.164470 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvgmh"] Sep 09 02:26:43.170865 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:43.170829 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9262767_c90e_4484_925b_20f9e5752a21.slice/crio-b9654215bd80d5176e1c8a17543038eba826c4b6c84fe5be0488edcfa3ef4017 WatchSource:0}: Error finding container b9654215bd80d5176e1c8a17543038eba826c4b6c84fe5be0488edcfa3ef4017: Status 404 returned error can't find the container with id b9654215bd80d5176e1c8a17543038eba826c4b6c84fe5be0488edcfa3ef4017 Sep 09 02:26:43.175282 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.175177 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk762"] Sep 09 02:26:43.177769 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:43.177737 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e611bc0_3863_4aa4_a0fc_3271a812cf6e.slice/crio-dc3e6cba5cf917e7a449dd33051327e813d902b8323b701fe2db777553b04eb5 WatchSource:0}: Error finding container dc3e6cba5cf917e7a449dd33051327e813d902b8323b701fe2db777553b04eb5: Status 404 returned error can't find the container with id dc3e6cba5cf917e7a449dd33051327e813d902b8323b701fe2db777553b04eb5 Sep 09 02:26:43.214989 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.214887 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk762" event={"ID":"e9262767-c90e-4484-925b-20f9e5752a21","Type":"ContainerStarted","Data":"b9654215bd80d5176e1c8a17543038eba826c4b6c84fe5be0488edcfa3ef4017"} Sep 09 02:26:43.217076 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.216998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvgmh" event={"ID":"6e611bc0-3863-4aa4-a0fc-3271a812cf6e","Type":"ContainerStarted","Data":"dc3e6cba5cf917e7a449dd33051327e813d902b8323b701fe2db777553b04eb5"} Sep 09 02:26:43.219107 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.218999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pdwv" event={"ID":"78da3fd3-157b-4409-97a6-ba963de0e8f0","Type":"ContainerStarted","Data":"d7d5404ddb2596712592d6cf1c21d2830f7732e6eb27ea2086cb6be1ed5f520a"} Sep 09 02:26:43.335813 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.335732 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t86xl\"" Sep 09 02:26:43.345515 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.345487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:43.672255 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.671908 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xmb7"] Sep 09 02:26:43.846750 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:43.846721 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd14b24-1c9c-4ded-9536-07ad17b7ae4b" path="/var/lib/kubelet/pods/1bd14b24-1c9c-4ded-9536-07ad17b7ae4b/volumes" Sep 09 02:26:44.225538 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:44.225487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xmb7" event={"ID":"9af9df04-bb42-4217-b20d-d221562e2b90","Type":"ContainerStarted","Data":"aa8020bdd7e45b5a0135d4eb20c887e0771410044964fc2216376dc9db87d649"} Sep 09 02:26:50.899382 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.899234 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fv242"] Sep 09 02:26:50.903630 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.902038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:50.907257 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.905845 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 02:26:50.907257 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.906092 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 02:26:50.907257 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.906301 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7c5x9\"" Sep 09 02:26:50.907257 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.906502 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 02:26:50.907257 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.906713 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 02:26:50.907257 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.907094 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 02:26:50.908058 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:50.907841 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 02:26:51.038705 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-root\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.038705 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcb09e04-3cad-4bd0-840f-88565d10c7b8-metrics-client-ca\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.038918 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-textfile\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.038918 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.038918 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brddz\" (UniqueName: \"kubernetes.io/projected/fcb09e04-3cad-4bd0-840f-88565d10c7b8-kube-api-access-brddz\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.038918 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-tls\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.038918 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.038918 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-sys\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.039255 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.038949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-wtmp\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.139779 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.139779 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-sys\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.139779 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-wtmp\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-root\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcb09e04-3cad-4bd0-840f-88565d10c7b8-metrics-client-ca\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-textfile\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brddz\" (UniqueName: \"kubernetes.io/projected/fcb09e04-3cad-4bd0-840f-88565d10c7b8-kube-api-access-brddz\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-tls\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.140006 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-wtmp\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140385 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.140076 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-root\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140385 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:51.140099 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 02:26:51.140385 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:26:51.140162 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-tls podName:fcb09e04-3cad-4bd0-840f-88565d10c7b8 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:51.640141173 +0000 UTC m=+74.301677228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-tls") pod "node-exporter-fv242" (UID: "fcb09e04-3cad-4bd0-840f-88565d10c7b8") : secret "node-exporter-tls" not found Sep 09 02:26:51.140385 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.139882 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcb09e04-3cad-4bd0-840f-88565d10c7b8-sys\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140596 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.140371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140596 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.140414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcb09e04-3cad-4bd0-840f-88565d10c7b8-metrics-client-ca\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.140710 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.140666 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-textfile\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.142810 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.142789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.148558 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.148530 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brddz\" (UniqueName: \"kubernetes.io/projected/fcb09e04-3cad-4bd0-840f-88565d10c7b8-kube-api-access-brddz\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.255537 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.255281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" event={"ID":"23d0c474-d3fa-4883-9d60-132972c71c0c","Type":"ContainerStarted","Data":"b3ae4acfd78cda2e1f4996ab67720810a1b9edc4a9324780342413f26e45e64b"} Sep 09 02:26:51.255537 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.255335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" event={"ID":"23d0c474-d3fa-4883-9d60-132972c71c0c","Type":"ContainerStarted","Data":"cbbd0cddb4b279c24002178e9beef09773cac4eec3f77f81f1ab62f9ee2cf363"} Sep 09 02:26:51.255537 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.255351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" event={"ID":"23d0c474-d3fa-4883-9d60-132972c71c0c","Type":"ContainerStarted","Data":"779d28ee9c8d764b282e45135a3a3e0c947258731e6dcba41488955f0d30cee5"} Sep 09 02:26:51.257034 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.257007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvgmh" event={"ID":"6e611bc0-3863-4aa4-a0fc-3271a812cf6e","Type":"ContainerStarted","Data":"1a72250eeb63a42792386fb05da2d2f2bfa20132ecd5f6b6de01990ec8c3d4ac"} Sep 09 02:26:51.259427 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.259164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pdwv" event={"ID":"78da3fd3-157b-4409-97a6-ba963de0e8f0","Type":"ContainerStarted","Data":"5b20def80af70d4ecc6133b9ebf8816345443b1c869a2daa99d1fa7468eb87ec"} Sep 09 02:26:51.259427 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.259222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pdwv" event={"ID":"78da3fd3-157b-4409-97a6-ba963de0e8f0","Type":"ContainerStarted","Data":"83ae3153afac695a6d30e586a263d099950e1a08933c0269510aee7ec8a926e5"} Sep 09 02:26:51.261272 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.261245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xmb7" event={"ID":"9af9df04-bb42-4217-b20d-d221562e2b90","Type":"ContainerStarted","Data":"9ab81d210088f8ee756eb81925fe0021fb2510d50ca5249c394ea20e01ad8a41"} Sep 09 02:26:51.261415 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.261294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xmb7" event={"ID":"9af9df04-bb42-4217-b20d-d221562e2b90","Type":"ContainerStarted","Data":"3c17bf149f2be8efeb3efd1a8223cf3c026c4076bcf6c1cb1f2259b50e815dc3"} Sep 09 02:26:51.261415 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.261325 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5xmb7" Sep 09 02:26:51.262977 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.262955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk762" event={"ID":"e9262767-c90e-4484-925b-20f9e5752a21","Type":"ContainerStarted","Data":"fa1e84911570db066ab4046f79e870f1a07fcc20f930151b7d1d50f51f379249"} Sep 09 02:26:51.263073 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.263010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:26:51.264643 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.264622 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" event={"ID":"5d7cece7-cb40-4dd1-99e1-00c04e141580","Type":"ContainerStarted","Data":"2e48c7d3492c279b5979d15ad370bc4aeca2fb1a50b28de927e79c538263f3ea"} Sep 09 02:26:51.276413 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.276373 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-754f887b6d-nt9fm" podStartSLOduration=2.3170422840000002 podStartE2EDuration="11.27636067s" totalImagesPullingTime="8.959318386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.275899616 +0000 UTC m=+73.937435692" watchObservedRunningTime="2026-09-09 02:26:51.27636067 +0000 UTC m=+73.937896738" Sep 09 02:26:51.290887 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.290840 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fk762" podStartSLOduration=65.881147534 podStartE2EDuration="1m13.290821716s" totalImagesPullingTime="7.409674182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.289507379 +0000 UTC m=+73.951043453" watchObservedRunningTime="2026-09-09 02:26:51.290821716 +0000 UTC m=+73.952357789" Sep 09 02:26:51.304567 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.304526 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-957459556-vfdhm" podStartSLOduration=2.326852541 podStartE2EDuration="11.30451324s" totalImagesPullingTime="8.977660699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.303818698 +0000 UTC m=+73.965354771" watchObservedRunningTime="2026-09-09 02:26:51.30451324 +0000 UTC m=+73.966049315" Sep 09 02:26:51.317260 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.317221 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rvgmh" podStartSLOduration=65.914438264 podStartE2EDuration="1m13.317208745s" totalImagesPullingTime="7.402770481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.316236033 +0000 UTC m=+73.977772107" watchObservedRunningTime="2026-09-09 02:26:51.317208745 +0000 UTC m=+73.978744855" Sep 09 02:26:51.332322 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.332276 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6pdwv" podStartSLOduration=65.80567553 podStartE2EDuration="1m13.332259976s" totalImagesPullingTime="7.526584446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.331705822 +0000 UTC m=+73.993241899" watchObservedRunningTime="2026-09-09 02:26:51.332259976 +0000 UTC m=+73.993796051" Sep 09 02:26:51.350620 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.350577 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5xmb7" podStartSLOduration=33.408409506 podStartE2EDuration="40.350563155s" totalImagesPullingTime="6.942153649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.349979434 +0000 UTC m=+74.011515509" watchObservedRunningTime="2026-09-09 02:26:51.350563155 +0000 UTC m=+74.012099229" Sep 09 02:26:51.644375 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.644331 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-tls\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.646525 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.646500 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcb09e04-3cad-4bd0-840f-88565d10c7b8-node-exporter-tls\") pod \"node-exporter-fv242\" (UID: \"fcb09e04-3cad-4bd0-840f-88565d10c7b8\") " pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.832107 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:51.832072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fv242" Sep 09 02:26:51.843574 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:26:51.843535 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb09e04_3cad_4bd0_840f_88565d10c7b8.slice/crio-d2a38791325e800e03b10a64d0876d863cca70f7f448454d4ea898d70256ebf1 WatchSource:0}: Error finding container d2a38791325e800e03b10a64d0876d863cca70f7f448454d4ea898d70256ebf1: Status 404 returned error can't find the container with id d2a38791325e800e03b10a64d0876d863cca70f7f448454d4ea898d70256ebf1 Sep 09 02:26:52.270282 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:52.270231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fv242" event={"ID":"fcb09e04-3cad-4bd0-840f-88565d10c7b8","Type":"ContainerStarted","Data":"d2a38791325e800e03b10a64d0876d863cca70f7f448454d4ea898d70256ebf1"} Sep 09 02:26:53.275480 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:53.275386 2581 generic.go:356] "Generic (PLEG): container finished" podID="fcb09e04-3cad-4bd0-840f-88565d10c7b8" containerID="6a42645d86011d172038b3c770d76395b9c68eea9e3e237baec61a55a659cd4f" exitCode=0 Sep 09 02:26:53.275480 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:53.275431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fv242" event={"ID":"fcb09e04-3cad-4bd0-840f-88565d10c7b8","Type":"ContainerDied","Data":"6a42645d86011d172038b3c770d76395b9c68eea9e3e237baec61a55a659cd4f"} Sep 09 02:26:54.281889 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:54.281853 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fv242" event={"ID":"fcb09e04-3cad-4bd0-840f-88565d10c7b8","Type":"ContainerStarted","Data":"9d67deed91ac6a7c1a4e44943aca5d875e62bbfe786bf100253af1262e38cfa2"} Sep 09 02:26:54.282376 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:54.281915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fv242" event={"ID":"fcb09e04-3cad-4bd0-840f-88565d10c7b8","Type":"ContainerStarted","Data":"0655ab4e188e638789c4a0480baee9f03d0c6abd9d88b3cd667edc6f0a2849b8"} Sep 09 02:26:54.301090 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:26:54.301039 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fv242" podStartSLOduration=3.257876109 podStartE2EDuration="4.301022148s" totalImagesPullingTime="980.802314ms" totalInitContainerRuntime="62.343725ms" isStatefulPod=true podCreationTimestamp="2026-09-09 02:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:54.299227725 +0000 UTC m=+76.960763813" watchObservedRunningTime="2026-09-09 02:26:54.301022148 +0000 UTC m=+76.962558262" Sep 09 02:27:01.273270 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:27:01.273154 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5xmb7" Sep 09 02:27:03.223585 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:27:03.223554 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bb9b4867d-wpcvr" Sep 09 02:27:22.273232 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:27:22.273200 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fk762" Sep 09 02:29:44.149445 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.149410 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd"] Sep 09 02:29:44.151514 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.151496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.153602 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.153578 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r6g5j\"" Sep 09 02:29:44.153892 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.153874 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 02:29:44.154441 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.154422 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 02:29:44.159774 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.159755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd"] Sep 09 02:29:44.309548 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.309509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.309757 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.309557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.309757 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.309593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpccj\" (UniqueName: \"kubernetes.io/projected/13c782bb-6b17-4efc-8035-dcd642ae159e-kube-api-access-vpccj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.410266 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.410175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.410266 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.410230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.410266 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.410260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpccj\" (UniqueName: \"kubernetes.io/projected/13c782bb-6b17-4efc-8035-dcd642ae159e-kube-api-access-vpccj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.410589 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.410569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.410626 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.410611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.418055 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.418021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpccj\" (UniqueName: \"kubernetes.io/projected/13c782bb-6b17-4efc-8035-dcd642ae159e-kube-api-access-vpccj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.461025 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.460988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:29:44.726985 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.726893 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd"] Sep 09 02:29:44.730832 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:29:44.730807 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c782bb_6b17_4efc_8035_dcd642ae159e.slice/crio-5477cd35fd33f6e7e2689f604a1b89ce7e6bee824bcda256dfb4391372181f4c WatchSource:0}: Error finding container 5477cd35fd33f6e7e2689f604a1b89ce7e6bee824bcda256dfb4391372181f4c: Status 404 returned error can't find the container with id 5477cd35fd33f6e7e2689f604a1b89ce7e6bee824bcda256dfb4391372181f4c Sep 09 02:29:44.852644 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:44.852608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" event={"ID":"13c782bb-6b17-4efc-8035-dcd642ae159e","Type":"ContainerStarted","Data":"5477cd35fd33f6e7e2689f604a1b89ce7e6bee824bcda256dfb4391372181f4c"} Sep 09 02:29:51.877335 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:51.877300 2581 generic.go:356] "Generic (PLEG): container finished" podID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerID="2de44930d2d17f736a1c9ba56f94bb0732da8f6288e2ad5dc7f73a680d6378fa" exitCode=0 Sep 09 02:29:51.877861 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:51.877372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" event={"ID":"13c782bb-6b17-4efc-8035-dcd642ae159e","Type":"ContainerDied","Data":"2de44930d2d17f736a1c9ba56f94bb0732da8f6288e2ad5dc7f73a680d6378fa"} Sep 09 02:29:56.895352 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:56.895313 2581 generic.go:356] "Generic (PLEG): container finished" podID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerID="41c7490d30719290b00ef4f1e5427775c9223ebe7ee450573a6465e34fe104a4" exitCode=0 Sep 09 02:29:56.895735 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:29:56.895411 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" event={"ID":"13c782bb-6b17-4efc-8035-dcd642ae159e","Type":"ContainerDied","Data":"41c7490d30719290b00ef4f1e5427775c9223ebe7ee450573a6465e34fe104a4"} Sep 09 02:30:03.923833 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:03.923795 2581 generic.go:356] "Generic (PLEG): container finished" podID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerID="b2f16e1299c53b2825e0ca4cbe9d735ec390443a929ce0c88e4ca24e29ec764b" exitCode=0 Sep 09 02:30:03.924221 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:03.923884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" event={"ID":"13c782bb-6b17-4efc-8035-dcd642ae159e","Type":"ContainerDied","Data":"b2f16e1299c53b2825e0ca4cbe9d735ec390443a929ce0c88e4ca24e29ec764b"} Sep 09 02:30:05.049616 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.049584 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:30:05.083204 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.083173 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-bundle\") pod \"13c782bb-6b17-4efc-8035-dcd642ae159e\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " Sep 09 02:30:05.083370 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.083223 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpccj\" (UniqueName: \"kubernetes.io/projected/13c782bb-6b17-4efc-8035-dcd642ae159e-kube-api-access-vpccj\") pod \"13c782bb-6b17-4efc-8035-dcd642ae159e\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " Sep 09 02:30:05.083370 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.083247 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-util\") pod \"13c782bb-6b17-4efc-8035-dcd642ae159e\" (UID: \"13c782bb-6b17-4efc-8035-dcd642ae159e\") " Sep 09 02:30:05.083901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.083870 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-bundle" (OuterVolumeSpecName: "bundle") pod "13c782bb-6b17-4efc-8035-dcd642ae159e" (UID: "13c782bb-6b17-4efc-8035-dcd642ae159e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:05.085412 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.085387 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c782bb-6b17-4efc-8035-dcd642ae159e-kube-api-access-vpccj" (OuterVolumeSpecName: "kube-api-access-vpccj") pod "13c782bb-6b17-4efc-8035-dcd642ae159e" (UID: "13c782bb-6b17-4efc-8035-dcd642ae159e"). InnerVolumeSpecName "kube-api-access-vpccj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:30:05.089012 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.088985 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-util" (OuterVolumeSpecName: "util") pod "13c782bb-6b17-4efc-8035-dcd642ae159e" (UID: "13c782bb-6b17-4efc-8035-dcd642ae159e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:05.184224 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.184115 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:05.184224 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.184164 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpccj\" (UniqueName: \"kubernetes.io/projected/13c782bb-6b17-4efc-8035-dcd642ae159e-kube-api-access-vpccj\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:05.184224 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.184175 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13c782bb-6b17-4efc-8035-dcd642ae159e-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:05.932837 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.932799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" event={"ID":"13c782bb-6b17-4efc-8035-dcd642ae159e","Type":"ContainerDied","Data":"5477cd35fd33f6e7e2689f604a1b89ce7e6bee824bcda256dfb4391372181f4c"} Sep 09 02:30:05.932837 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.932819 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540w5mqd" Sep 09 02:30:05.933055 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:05.932850 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5477cd35fd33f6e7e2689f604a1b89ce7e6bee824bcda256dfb4391372181f4c" Sep 09 02:30:12.067824 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.067788 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk"] Sep 09 02:30:12.068273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.068059 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerName="util" Sep 09 02:30:12.068273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.068073 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerName="util" Sep 09 02:30:12.068273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.068085 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerName="pull" Sep 09 02:30:12.068273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.068090 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerName="pull" Sep 09 02:30:12.068273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.068106 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerName="extract" Sep 09 02:30:12.068273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.068112 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerName="extract" Sep 09 02:30:12.068273 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.068160 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="13c782bb-6b17-4efc-8035-dcd642ae159e" containerName="extract" Sep 09 02:30:12.071623 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.071606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.074452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.074433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h7qqz\"" Sep 09 02:30:12.074735 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.074714 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 09 02:30:12.074864 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.074848 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 09 02:30:12.082553 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.082528 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk"] Sep 09 02:30:12.131994 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.131961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj8kk\" (UID: \"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.131994 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.132004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btq7n\" (UniqueName: \"kubernetes.io/projected/44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb-kube-api-access-btq7n\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj8kk\" (UID: \"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.232539 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.232494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj8kk\" (UID: \"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.232711 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.232554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btq7n\" (UniqueName: \"kubernetes.io/projected/44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb-kube-api-access-btq7n\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj8kk\" (UID: \"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.233013 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.232993 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj8kk\" (UID: \"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.240174 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.240152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btq7n\" (UniqueName: \"kubernetes.io/projected/44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb-kube-api-access-btq7n\") pod \"cert-manager-operator-controller-manager-55c444bf86-lj8kk\" (UID: \"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.380484 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.380392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" Sep 09 02:30:12.652140 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.652107 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk"] Sep 09 02:30:12.654909 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:30:12.654881 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d98943_b2b2_4e0c_9e7a_19e1d1d12bbb.slice/crio-7884e9ed49f7400461d75a2aa465484b0df57f783f6b9191a83d87fc426f156d WatchSource:0}: Error finding container 7884e9ed49f7400461d75a2aa465484b0df57f783f6b9191a83d87fc426f156d: Status 404 returned error can't find the container with id 7884e9ed49f7400461d75a2aa465484b0df57f783f6b9191a83d87fc426f156d Sep 09 02:30:12.960080 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:12.960000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" event={"ID":"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb","Type":"ContainerStarted","Data":"7884e9ed49f7400461d75a2aa465484b0df57f783f6b9191a83d87fc426f156d"} Sep 09 02:30:14.969568 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:14.969534 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" event={"ID":"44d98943-b2b2-4e0c-9e7a-19e1d1d12bbb","Type":"ContainerStarted","Data":"6b8cab3d13b394eb927798e091d356b3804450d1aacc5b140a73d69e36357a68"} Sep 09 02:30:14.993548 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:14.993479 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lj8kk" podStartSLOduration=1.265234452 podStartE2EDuration="2.993456607s" totalImagesPullingTime="1.728222155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:30:14.992285678 +0000 UTC m=+277.653821751" watchObservedRunningTime="2026-09-09 02:30:14.993456607 +0000 UTC m=+277.654992683" Sep 09 02:30:16.193977 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.193945 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7"] Sep 09 02:30:16.196094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.196075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.198315 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.198293 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 02:30:16.198315 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.198311 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 02:30:16.199205 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.199158 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r6g5j\"" Sep 09 02:30:16.205052 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.205033 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7"] Sep 09 02:30:16.262592 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.262542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.262758 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.262612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krcqw\" (UniqueName: \"kubernetes.io/projected/6343b764-e244-41e3-9a3f-054b3724578b-kube-api-access-krcqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.262758 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.262654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.363904 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.363864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.363904 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.363911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krcqw\" (UniqueName: \"kubernetes.io/projected/6343b764-e244-41e3-9a3f-054b3724578b-kube-api-access-krcqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.364126 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.363975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.364338 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.364315 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.364386 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.364319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.371770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.371740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krcqw\" (UniqueName: \"kubernetes.io/projected/6343b764-e244-41e3-9a3f-054b3724578b-kube-api-access-krcqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.505472 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.505390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:16.771856 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.771566 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7"] Sep 09 02:30:16.776621 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:30:16.776591 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6343b764_e244_41e3_9a3f_054b3724578b.slice/crio-bbe96455c23c9f2c1cb04d15837ce38ae32ece261e78c5e761475e2acb5421ed WatchSource:0}: Error finding container bbe96455c23c9f2c1cb04d15837ce38ae32ece261e78c5e761475e2acb5421ed: Status 404 returned error can't find the container with id bbe96455c23c9f2c1cb04d15837ce38ae32ece261e78c5e761475e2acb5421ed Sep 09 02:30:16.978452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.978417 2581 generic.go:356] "Generic (PLEG): container finished" podID="6343b764-e244-41e3-9a3f-054b3724578b" containerID="e0c8705cb720681944ac2374b6fe16856f871e6b1aa4b7192dbc4dbfd12aea4d" exitCode=0 Sep 09 02:30:16.978619 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.978483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" event={"ID":"6343b764-e244-41e3-9a3f-054b3724578b","Type":"ContainerDied","Data":"e0c8705cb720681944ac2374b6fe16856f871e6b1aa4b7192dbc4dbfd12aea4d"} Sep 09 02:30:16.978619 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:16.978534 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" event={"ID":"6343b764-e244-41e3-9a3f-054b3724578b","Type":"ContainerStarted","Data":"bbe96455c23c9f2c1cb04d15837ce38ae32ece261e78c5e761475e2acb5421ed"} Sep 09 02:30:19.993501 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:19.993466 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" event={"ID":"6343b764-e244-41e3-9a3f-054b3724578b","Type":"ContainerStarted","Data":"8ca1f743cfde7eec7ba05d15b9d12a98a850067e445ccba7d34aad7d65eb9470"} Sep 09 02:30:20.999556 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:20.999517 2581 generic.go:356] "Generic (PLEG): container finished" podID="6343b764-e244-41e3-9a3f-054b3724578b" containerID="8ca1f743cfde7eec7ba05d15b9d12a98a850067e445ccba7d34aad7d65eb9470" exitCode=0 Sep 09 02:30:20.999899 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:20.999600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" event={"ID":"6343b764-e244-41e3-9a3f-054b3724578b","Type":"ContainerDied","Data":"8ca1f743cfde7eec7ba05d15b9d12a98a850067e445ccba7d34aad7d65eb9470"} Sep 09 02:30:22.005855 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:22.005813 2581 generic.go:356] "Generic (PLEG): container finished" podID="6343b764-e244-41e3-9a3f-054b3724578b" containerID="b06cc453c122fc172d930f80a02d877f280f1d4f11c30009fcc978ad38d080a1" exitCode=0 Sep 09 02:30:22.006270 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:22.005910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" event={"ID":"6343b764-e244-41e3-9a3f-054b3724578b","Type":"ContainerDied","Data":"b06cc453c122fc172d930f80a02d877f280f1d4f11c30009fcc978ad38d080a1"} Sep 09 02:30:23.135646 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.135616 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:23.219870 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.219834 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krcqw\" (UniqueName: \"kubernetes.io/projected/6343b764-e244-41e3-9a3f-054b3724578b-kube-api-access-krcqw\") pod \"6343b764-e244-41e3-9a3f-054b3724578b\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " Sep 09 02:30:23.220039 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.219880 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-bundle\") pod \"6343b764-e244-41e3-9a3f-054b3724578b\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " Sep 09 02:30:23.220039 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.219901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-util\") pod \"6343b764-e244-41e3-9a3f-054b3724578b\" (UID: \"6343b764-e244-41e3-9a3f-054b3724578b\") " Sep 09 02:30:23.220360 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.220331 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-bundle" (OuterVolumeSpecName: "bundle") pod "6343b764-e244-41e3-9a3f-054b3724578b" (UID: "6343b764-e244-41e3-9a3f-054b3724578b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:23.222168 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.222136 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6343b764-e244-41e3-9a3f-054b3724578b-kube-api-access-krcqw" (OuterVolumeSpecName: "kube-api-access-krcqw") pod "6343b764-e244-41e3-9a3f-054b3724578b" (UID: "6343b764-e244-41e3-9a3f-054b3724578b"). InnerVolumeSpecName "kube-api-access-krcqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:30:23.224828 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.224802 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-util" (OuterVolumeSpecName: "util") pod "6343b764-e244-41e3-9a3f-054b3724578b" (UID: "6343b764-e244-41e3-9a3f-054b3724578b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:23.321335 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.321296 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krcqw\" (UniqueName: \"kubernetes.io/projected/6343b764-e244-41e3-9a3f-054b3724578b-kube-api-access-krcqw\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:23.321335 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.321331 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:23.321529 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:23.321348 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6343b764-e244-41e3-9a3f-054b3724578b-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:24.015343 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:24.015306 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" event={"ID":"6343b764-e244-41e3-9a3f-054b3724578b","Type":"ContainerDied","Data":"bbe96455c23c9f2c1cb04d15837ce38ae32ece261e78c5e761475e2acb5421ed"} Sep 09 02:30:24.015343 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:24.015328 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxg8n7" Sep 09 02:30:24.015600 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:24.015355 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbe96455c23c9f2c1cb04d15837ce38ae32ece261e78c5e761475e2acb5421ed" Sep 09 02:30:37.395428 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395392 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s"] Sep 09 02:30:37.395912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395642 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6343b764-e244-41e3-9a3f-054b3724578b" containerName="util" Sep 09 02:30:37.395912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395653 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6343b764-e244-41e3-9a3f-054b3724578b" containerName="util" Sep 09 02:30:37.395912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395667 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6343b764-e244-41e3-9a3f-054b3724578b" containerName="pull" Sep 09 02:30:37.395912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395673 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6343b764-e244-41e3-9a3f-054b3724578b" containerName="pull" Sep 09 02:30:37.395912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395679 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6343b764-e244-41e3-9a3f-054b3724578b" containerName="extract" Sep 09 02:30:37.395912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395684 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6343b764-e244-41e3-9a3f-054b3724578b" containerName="extract" Sep 09 02:30:37.395912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.395730 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6343b764-e244-41e3-9a3f-054b3724578b" containerName="extract" Sep 09 02:30:37.399666 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.399646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.401936 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.401897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r6g5j\"" Sep 09 02:30:37.402048 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.401974 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 02:30:37.402048 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.401999 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 02:30:37.410998 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.410910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s"] Sep 09 02:30:37.531780 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.531733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.531981 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.531813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tqt8\" (UniqueName: \"kubernetes.io/projected/9e7d1cb2-52bf-4613-b991-f12b8677324e-kube-api-access-7tqt8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.531981 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.531863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.633244 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.633204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tqt8\" (UniqueName: \"kubernetes.io/projected/9e7d1cb2-52bf-4613-b991-f12b8677324e-kube-api-access-7tqt8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.633244 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.633246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.633439 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.633365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.633558 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.633543 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.633724 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.633704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.641393 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.641369 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tqt8\" (UniqueName: \"kubernetes.io/projected/9e7d1cb2-52bf-4613-b991-f12b8677324e-kube-api-access-7tqt8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.716452 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.716372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r6g5j\"" Sep 09 02:30:37.725326 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.725305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:37.760077 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.760035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:30:37.761292 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.761266 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:30:37.764159 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.764136 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 02:30:37.999259 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:37.998139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s"] Sep 09 02:30:38.000651 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:30:38.000620 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7d1cb2_52bf_4613_b991_f12b8677324e.slice/crio-1557e144237c00362a2d475ed9eb354a7271a0dbc7aeabce3427fc99578f9def WatchSource:0}: Error finding container 1557e144237c00362a2d475ed9eb354a7271a0dbc7aeabce3427fc99578f9def: Status 404 returned error can't find the container with id 1557e144237c00362a2d475ed9eb354a7271a0dbc7aeabce3427fc99578f9def Sep 09 02:30:38.077178 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:38.077142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" event={"ID":"9e7d1cb2-52bf-4613-b991-f12b8677324e","Type":"ContainerStarted","Data":"95158fbdf5ba0f8a9caa84759c91789e2bffb3cf5bfd794db1e21cd99bcd9688"} Sep 09 02:30:38.077343 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:38.077197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" event={"ID":"9e7d1cb2-52bf-4613-b991-f12b8677324e","Type":"ContainerStarted","Data":"1557e144237c00362a2d475ed9eb354a7271a0dbc7aeabce3427fc99578f9def"} Sep 09 02:30:39.082395 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:39.082357 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerID="95158fbdf5ba0f8a9caa84759c91789e2bffb3cf5bfd794db1e21cd99bcd9688" exitCode=0 Sep 09 02:30:39.082771 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:39.082437 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" event={"ID":"9e7d1cb2-52bf-4613-b991-f12b8677324e","Type":"ContainerDied","Data":"95158fbdf5ba0f8a9caa84759c91789e2bffb3cf5bfd794db1e21cd99bcd9688"} Sep 09 02:30:39.082866 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:39.082852 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 02:30:40.088491 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:40.088451 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerID="402fa40cac5475d2ebe5cd48ed0773eca51733460cc63b31a84c745a0e072e22" exitCode=0 Sep 09 02:30:40.088842 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:40.088539 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" event={"ID":"9e7d1cb2-52bf-4613-b991-f12b8677324e","Type":"ContainerDied","Data":"402fa40cac5475d2ebe5cd48ed0773eca51733460cc63b31a84c745a0e072e22"} Sep 09 02:30:41.096005 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:41.095960 2581 generic.go:356] "Generic (PLEG): container finished" podID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerID="5bb36f1a0493a7ac8b06624957b7e27a2899268aa87a8a919c3231af57b2902b" exitCode=0 Sep 09 02:30:41.096370 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:41.095996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" event={"ID":"9e7d1cb2-52bf-4613-b991-f12b8677324e","Type":"ContainerDied","Data":"5bb36f1a0493a7ac8b06624957b7e27a2899268aa87a8a919c3231af57b2902b"} Sep 09 02:30:42.218512 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.218486 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:42.272291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.272260 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-util\") pod \"9e7d1cb2-52bf-4613-b991-f12b8677324e\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " Sep 09 02:30:42.272291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.272298 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tqt8\" (UniqueName: \"kubernetes.io/projected/9e7d1cb2-52bf-4613-b991-f12b8677324e-kube-api-access-7tqt8\") pod \"9e7d1cb2-52bf-4613-b991-f12b8677324e\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " Sep 09 02:30:42.272503 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.272328 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-bundle\") pod \"9e7d1cb2-52bf-4613-b991-f12b8677324e\" (UID: \"9e7d1cb2-52bf-4613-b991-f12b8677324e\") " Sep 09 02:30:42.273075 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.273047 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-bundle" (OuterVolumeSpecName: "bundle") pod "9e7d1cb2-52bf-4613-b991-f12b8677324e" (UID: "9e7d1cb2-52bf-4613-b991-f12b8677324e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:42.274357 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.274332 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7d1cb2-52bf-4613-b991-f12b8677324e-kube-api-access-7tqt8" (OuterVolumeSpecName: "kube-api-access-7tqt8") pod "9e7d1cb2-52bf-4613-b991-f12b8677324e" (UID: "9e7d1cb2-52bf-4613-b991-f12b8677324e"). InnerVolumeSpecName "kube-api-access-7tqt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:30:42.277987 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.277951 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-util" (OuterVolumeSpecName: "util") pod "9e7d1cb2-52bf-4613-b991-f12b8677324e" (UID: "9e7d1cb2-52bf-4613-b991-f12b8677324e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:42.372917 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.372827 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:42.372917 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.372858 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tqt8\" (UniqueName: \"kubernetes.io/projected/9e7d1cb2-52bf-4613-b991-f12b8677324e-kube-api-access-7tqt8\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:42.372917 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:42.372869 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e7d1cb2-52bf-4613-b991-f12b8677324e-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:43.105554 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:43.105516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" event={"ID":"9e7d1cb2-52bf-4613-b991-f12b8677324e","Type":"ContainerDied","Data":"1557e144237c00362a2d475ed9eb354a7271a0dbc7aeabce3427fc99578f9def"} Sep 09 02:30:43.105554 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:43.105540 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcs22s" Sep 09 02:30:43.105752 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:43.105573 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1557e144237c00362a2d475ed9eb354a7271a0dbc7aeabce3427fc99578f9def" Sep 09 02:30:53.398571 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398534 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5"] Sep 09 02:30:53.398979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398782 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerName="extract" Sep 09 02:30:53.398979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398793 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerName="extract" Sep 09 02:30:53.398979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398811 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerName="util" Sep 09 02:30:53.398979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398816 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerName="util" Sep 09 02:30:53.398979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398822 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerName="pull" Sep 09 02:30:53.398979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398828 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerName="pull" Sep 09 02:30:53.398979 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.398871 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7d1cb2-52bf-4613-b991-f12b8677324e" containerName="extract" Sep 09 02:30:53.401261 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.401243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.404937 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.404898 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 02:30:53.405076 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.405056 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r6g5j\"" Sep 09 02:30:53.405967 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.405948 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 02:30:53.414786 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.414764 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5"] Sep 09 02:30:53.556693 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.556660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.556693 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.556700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.556882 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.556723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j8tx\" (UniqueName: \"kubernetes.io/projected/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-kube-api-access-2j8tx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.658107 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.658016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.658107 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.658073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.658283 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.658107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j8tx\" (UniqueName: \"kubernetes.io/projected/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-kube-api-access-2j8tx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.658489 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.658463 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.658524 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.658470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.672247 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.672218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j8tx\" (UniqueName: \"kubernetes.io/projected/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-kube-api-access-2j8tx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.710019 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.709984 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:53.980034 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:53.979970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5"] Sep 09 02:30:53.982811 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:30:53.982785 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbc8ff5_f03c_4df4_b41b_9fca0c318dbd.slice/crio-7171e7808fa5894ca7654e144bf08ad9f3f4b51791959bd7992bf009ba6c5a51 WatchSource:0}: Error finding container 7171e7808fa5894ca7654e144bf08ad9f3f4b51791959bd7992bf009ba6c5a51: Status 404 returned error can't find the container with id 7171e7808fa5894ca7654e144bf08ad9f3f4b51791959bd7992bf009ba6c5a51 Sep 09 02:30:54.158350 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.158310 2581 generic.go:356] "Generic (PLEG): container finished" podID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerID="b488a7d8b72c8452954b67a4fab342c58c5a3713c91b235f90fdd10a568166b9" exitCode=0 Sep 09 02:30:54.158537 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.158398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" event={"ID":"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd","Type":"ContainerDied","Data":"b488a7d8b72c8452954b67a4fab342c58c5a3713c91b235f90fdd10a568166b9"} Sep 09 02:30:54.158537 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.158489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" event={"ID":"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd","Type":"ContainerStarted","Data":"7171e7808fa5894ca7654e144bf08ad9f3f4b51791959bd7992bf009ba6c5a51"} Sep 09 02:30:54.770639 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.770603 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt"] Sep 09 02:30:54.772874 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.772855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.775864 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.775839 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 02:30:54.776002 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.775884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w24vw\"" Sep 09 02:30:54.776002 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.775967 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 02:30:54.776200 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.776182 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 02:30:54.776297 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.776279 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 02:30:54.790786 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.790759 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt"] Sep 09 02:30:54.868478 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.868453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.868572 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.868495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-manifests\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.868572 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.868514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.868572 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.868559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-tmp\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.868669 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.868599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qft\" (UniqueName: \"kubernetes.io/projected/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-kube-api-access-m9qft\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.969042 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.969003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qft\" (UniqueName: \"kubernetes.io/projected/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-kube-api-access-m9qft\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.969238 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.969214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.969303 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.969269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-manifests\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.969303 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.969289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.969393 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.969307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-tmp\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.969782 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.969750 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-manifests\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.971743 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.971721 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-tmp\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.971859 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.971777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.971859 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.971811 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:54.976341 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:54.976319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qft\" (UniqueName: \"kubernetes.io/projected/ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc-kube-api-access-m9qft\") pod \"opendatahub-operator-controller-manager-66fb449fdb-95bmt\" (UID: \"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:55.084824 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:55.084789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:30:55.164797 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:55.164762 2581 generic.go:356] "Generic (PLEG): container finished" podID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerID="c8365c57c694ac9c43fec8812dc3571cb1646354db7409d435be890f9f41d7b4" exitCode=0 Sep 09 02:30:55.164957 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:55.164847 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" event={"ID":"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd","Type":"ContainerDied","Data":"c8365c57c694ac9c43fec8812dc3571cb1646354db7409d435be890f9f41d7b4"} Sep 09 02:30:55.381062 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:55.381036 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt"] Sep 09 02:30:55.383388 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:30:55.383361 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9ccd48_4b7f_4f1e_a71e_51dfbb0cfbdc.slice/crio-e99c0abd1dd29b25dfc33e023e1943ddb4cfd2a7e227c4d5b3c7a895da4b0f96 WatchSource:0}: Error finding container e99c0abd1dd29b25dfc33e023e1943ddb4cfd2a7e227c4d5b3c7a895da4b0f96: Status 404 returned error can't find the container with id e99c0abd1dd29b25dfc33e023e1943ddb4cfd2a7e227c4d5b3c7a895da4b0f96 Sep 09 02:30:56.173661 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:56.173621 2581 generic.go:356] "Generic (PLEG): container finished" podID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerID="20f5ece0542a222aea16268000a06340887a309820576d67616f8e9a7ac759e6" exitCode=0 Sep 09 02:30:56.174206 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:56.173790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" event={"ID":"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd","Type":"ContainerDied","Data":"20f5ece0542a222aea16268000a06340887a309820576d67616f8e9a7ac759e6"} Sep 09 02:30:56.175675 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:56.175644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" event={"ID":"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc","Type":"ContainerStarted","Data":"e99c0abd1dd29b25dfc33e023e1943ddb4cfd2a7e227c4d5b3c7a895da4b0f96"} Sep 09 02:30:57.312804 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.312776 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:57.390092 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.390052 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-util\") pod \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " Sep 09 02:30:57.390092 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.390101 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j8tx\" (UniqueName: \"kubernetes.io/projected/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-kube-api-access-2j8tx\") pod \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " Sep 09 02:30:57.390319 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.390202 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-bundle\") pod \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\" (UID: \"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd\") " Sep 09 02:30:57.391062 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.391029 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-bundle" (OuterVolumeSpecName: "bundle") pod "cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" (UID: "cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:57.392482 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.392454 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-kube-api-access-2j8tx" (OuterVolumeSpecName: "kube-api-access-2j8tx") pod "cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" (UID: "cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd"). InnerVolumeSpecName "kube-api-access-2j8tx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:30:57.396816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.396789 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-util" (OuterVolumeSpecName: "util") pod "cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" (UID: "cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:30:57.491035 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.490950 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:57.491035 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.490987 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j8tx\" (UniqueName: \"kubernetes.io/projected/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-kube-api-access-2j8tx\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:57.491035 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:57.491004 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:30:58.186982 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:58.186887 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" Sep 09 02:30:58.186982 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:58.186892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l4wk5" event={"ID":"cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd","Type":"ContainerDied","Data":"7171e7808fa5894ca7654e144bf08ad9f3f4b51791959bd7992bf009ba6c5a51"} Sep 09 02:30:58.187169 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:58.187013 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7171e7808fa5894ca7654e144bf08ad9f3f4b51791959bd7992bf009ba6c5a51" Sep 09 02:30:59.192116 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:30:59.192020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" event={"ID":"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc","Type":"ContainerStarted","Data":"dee339ca180513317a4e0589ab0da830ddd4b6ba1ff0a72869dae9ce88b7ac49"} Sep 09 02:31:00.197832 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:00.197798 2581 generic.go:356] "Generic (PLEG): container finished" podID="ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc" containerID="dee339ca180513317a4e0589ab0da830ddd4b6ba1ff0a72869dae9ce88b7ac49" exitCode=0 Sep 09 02:31:00.198234 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:00.197851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" event={"ID":"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc","Type":"ContainerDied","Data":"dee339ca180513317a4e0589ab0da830ddd4b6ba1ff0a72869dae9ce88b7ac49"} Sep 09 02:31:01.203395 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:01.203359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" event={"ID":"ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc","Type":"ContainerStarted","Data":"aba1527eefaf2e1bda0c4c072531d4e3d0f452e34740029e9a526d0ed0876b5f"} Sep 09 02:31:01.203740 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:01.203499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:31:01.225506 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:01.225449 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" podStartSLOduration=2.324931482 podStartE2EDuration="7.225432353s" totalImagesPullingTime="3.849268701s" totalInitContainerRuntime="1.05123217s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:30:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:01.224330118 +0000 UTC m=+323.885866192" watchObservedRunningTime="2026-09-09 02:31:01.225432353 +0000 UTC m=+323.886968426" Sep 09 02:31:12.209689 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:12.209650 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-95bmt" Sep 09 02:31:14.452535 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452506 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-564645476c-ltxf6"] Sep 09 02:31:14.452901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452753 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerName="pull" Sep 09 02:31:14.452901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452764 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerName="pull" Sep 09 02:31:14.452901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452781 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerName="util" Sep 09 02:31:14.452901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452787 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerName="util" Sep 09 02:31:14.452901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452797 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerName="extract" Sep 09 02:31:14.452901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452801 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerName="extract" Sep 09 02:31:14.452901 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.452845 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdbc8ff5-f03c-4df4-b41b-9fca0c318dbd" containerName="extract" Sep 09 02:31:14.540992 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.540960 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-564645476c-ltxf6"] Sep 09 02:31:14.541165 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.541059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.543407 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.543350 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 02:31:14.543407 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.543351 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-chfmm\"" Sep 09 02:31:14.543407 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.543399 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 02:31:14.543628 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.543351 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 02:31:14.543628 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.543428 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 02:31:14.723144 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.723110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60254c0d-086c-4dba-8c00-56ce53375e9b-tmp\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.723323 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.723176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60254c0d-086c-4dba-8c00-56ce53375e9b-tls-certs\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.723323 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.723285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2m2\" (UniqueName: \"kubernetes.io/projected/60254c0d-086c-4dba-8c00-56ce53375e9b-kube-api-access-4t2m2\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.824256 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.824225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60254c0d-086c-4dba-8c00-56ce53375e9b-tls-certs\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.824408 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.824285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2m2\" (UniqueName: \"kubernetes.io/projected/60254c0d-086c-4dba-8c00-56ce53375e9b-kube-api-access-4t2m2\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.824408 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.824316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60254c0d-086c-4dba-8c00-56ce53375e9b-tmp\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.826600 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.826575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60254c0d-086c-4dba-8c00-56ce53375e9b-tmp\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.826804 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.826786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60254c0d-086c-4dba-8c00-56ce53375e9b-tls-certs\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.832494 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.832469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2m2\" (UniqueName: \"kubernetes.io/projected/60254c0d-086c-4dba-8c00-56ce53375e9b-kube-api-access-4t2m2\") pod \"kube-auth-proxy-564645476c-ltxf6\" (UID: \"60254c0d-086c-4dba-8c00-56ce53375e9b\") " pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:14.850364 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:14.850335 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" Sep 09 02:31:15.127091 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:15.127048 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-564645476c-ltxf6"] Sep 09 02:31:15.130401 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:31:15.130354 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60254c0d_086c_4dba_8c00_56ce53375e9b.slice/crio-193fff02a4ea7e6888f2359dd4cc187e7889b7ea698caaec52cfc31e6d924c0f WatchSource:0}: Error finding container 193fff02a4ea7e6888f2359dd4cc187e7889b7ea698caaec52cfc31e6d924c0f: Status 404 returned error can't find the container with id 193fff02a4ea7e6888f2359dd4cc187e7889b7ea698caaec52cfc31e6d924c0f Sep 09 02:31:15.263505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:15.263467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" event={"ID":"60254c0d-086c-4dba-8c00-56ce53375e9b","Type":"ContainerStarted","Data":"193fff02a4ea7e6888f2359dd4cc187e7889b7ea698caaec52cfc31e6d924c0f"} Sep 09 02:31:18.280060 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:18.279966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" event={"ID":"60254c0d-086c-4dba-8c00-56ce53375e9b","Type":"ContainerStarted","Data":"7b4f14caefa5299227f55f6486217dc6e89e535332a6981c7dbe0e2ff2c8d8e5"} Sep 09 02:31:18.296201 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:18.296150 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-564645476c-ltxf6" podStartSLOduration=1.458369975 podStartE2EDuration="4.29613269s" totalImagesPullingTime="2.837762715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:18.294986333 +0000 UTC m=+340.956522407" watchObservedRunningTime="2026-09-09 02:31:18.29613269 +0000 UTC m=+340.957668765" Sep 09 02:31:23.687296 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.687253 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw"] Sep 09 02:31:23.690885 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.690864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.693140 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.693114 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zvrc5\"" Sep 09 02:31:23.693140 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.693129 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 02:31:23.701790 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.701762 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw"] Sep 09 02:31:23.790072 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790029 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b699a2-2cdb-427c-9879-a019a7a23968-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790072 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790317 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790317 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790317 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790317 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77w9x\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-kube-api-access-77w9x\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790478 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790478 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b699a2-2cdb-427c-9879-a019a7a23968-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.790478 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.790403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891030 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.890989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b699a2-2cdb-427c-9879-a019a7a23968-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891030 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77w9x\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-kube-api-access-77w9x\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b699a2-2cdb-427c-9879-a019a7a23968-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891595 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.891879 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b699a2-2cdb-427c-9879-a019a7a23968-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.892006 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891883 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.892006 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.891963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.892115 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.892030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.893758 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.893733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.893967 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.893950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b699a2-2cdb-427c-9879-a019a7a23968-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.898765 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.898733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77w9x\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-kube-api-access-77w9x\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.899197 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.899176 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:23.944493 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.944415 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r"] Sep 09 02:31:23.948832 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.948812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.958059 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.958037 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r"] Sep 09 02:31:23.992101 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992101 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgbj\" (UniqueName: \"kubernetes.io/projected/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-kube-api-access-ncgbj\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992527 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:23.992527 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:23.992381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.002906 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.002882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:24.093483 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgbj\" (UniqueName: \"kubernetes.io/projected/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-kube-api-access-ncgbj\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093649 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093649 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093649 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093649 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093649 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093649 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093955 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.093955 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.093700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.094067 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.094016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.094163 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.094134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.094282 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.094230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.094282 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.094253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.094564 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.094546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.096003 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.095983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.096253 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.096236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.102277 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.102249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgbj\" (UniqueName: \"kubernetes.io/projected/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-kube-api-access-ncgbj\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.104317 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.104296 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4810b94b-b57f-4ee9-b170-4fe7b56f0d0c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r\" (UID: \"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.259249 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.259160 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:24.272981 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.272842 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw"] Sep 09 02:31:24.275623 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:31:24.275592 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b699a2_2cdb_427c_9879_a019a7a23968.slice/crio-0a9f60869620ad6b37e7630009d00ca18a967940a338544a3a626ed4e2ebf7de WatchSource:0}: Error finding container 0a9f60869620ad6b37e7630009d00ca18a967940a338544a3a626ed4e2ebf7de: Status 404 returned error can't find the container with id 0a9f60869620ad6b37e7630009d00ca18a967940a338544a3a626ed4e2ebf7de Sep 09 02:31:24.305871 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.305837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" event={"ID":"72b699a2-2cdb-427c-9879-a019a7a23968","Type":"ContainerStarted","Data":"0a9f60869620ad6b37e7630009d00ca18a967940a338544a3a626ed4e2ebf7de"} Sep 09 02:31:24.533316 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:24.533235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r"] Sep 09 02:31:24.536214 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:31:24.536188 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4810b94b_b57f_4ee9_b170_4fe7b56f0d0c.slice/crio-eada658807376a24efa51a46c3dec1416082d3470ccf2857e14a0ec6dc9a0255 WatchSource:0}: Error finding container eada658807376a24efa51a46c3dec1416082d3470ccf2857e14a0ec6dc9a0255: Status 404 returned error can't find the container with id eada658807376a24efa51a46c3dec1416082d3470ccf2857e14a0ec6dc9a0255 Sep 09 02:31:25.073090 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.073055 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gqbj2"] Sep 09 02:31:25.076146 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.076124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.078837 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.078818 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qgnbc\"" Sep 09 02:31:25.079181 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.079160 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 09 02:31:25.093161 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.093125 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gqbj2"] Sep 09 02:31:25.100850 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.100822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xbn5\" (UniqueName: \"kubernetes.io/projected/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-kube-api-access-5xbn5\") pod \"odh-model-controller-7998c67dc4-gqbj2\" (UID: \"9c04e1f4-0c2c-42d4-86c3-c3372a52a886\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.100999 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.100879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-cert\") pod \"odh-model-controller-7998c67dc4-gqbj2\" (UID: \"9c04e1f4-0c2c-42d4-86c3-c3372a52a886\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.201812 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.201767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xbn5\" (UniqueName: \"kubernetes.io/projected/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-kube-api-access-5xbn5\") pod \"odh-model-controller-7998c67dc4-gqbj2\" (UID: \"9c04e1f4-0c2c-42d4-86c3-c3372a52a886\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.202017 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.201846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-cert\") pod \"odh-model-controller-7998c67dc4-gqbj2\" (UID: \"9c04e1f4-0c2c-42d4-86c3-c3372a52a886\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.202017 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:31:25.202005 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 09 02:31:25.202116 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:31:25.202077 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-cert podName:9c04e1f4-0c2c-42d4-86c3-c3372a52a886 nodeName:}" failed. No retries permitted until 2026-09-09 02:31:25.702057678 +0000 UTC m=+348.363593734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-cert") pod "odh-model-controller-7998c67dc4-gqbj2" (UID: "9c04e1f4-0c2c-42d4-86c3-c3372a52a886") : secret "odh-model-controller-webhook-cert" not found Sep 09 02:31:25.212366 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.212332 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xbn5\" (UniqueName: \"kubernetes.io/projected/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-kube-api-access-5xbn5\") pod \"odh-model-controller-7998c67dc4-gqbj2\" (UID: \"9c04e1f4-0c2c-42d4-86c3-c3372a52a886\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.311493 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.311457 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" event={"ID":"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c","Type":"ContainerStarted","Data":"eada658807376a24efa51a46c3dec1416082d3470ccf2857e14a0ec6dc9a0255"} Sep 09 02:31:25.525619 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.525529 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kjzlg"] Sep 09 02:31:25.529197 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.529170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:25.531491 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.531470 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-b9q6t\"" Sep 09 02:31:25.531614 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.531474 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 09 02:31:25.535505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.535466 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kjzlg"] Sep 09 02:31:25.605839 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.605787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfvv\" (UniqueName: \"kubernetes.io/projected/2f437c8b-8951-4760-a146-c28a25307841-kube-api-access-lxfvv\") pod \"model-serving-api-54d89bd5fc-kjzlg\" (UID: \"2f437c8b-8951-4760-a146-c28a25307841\") " pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:25.606067 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.605879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f437c8b-8951-4760-a146-c28a25307841-tls-certs\") pod \"model-serving-api-54d89bd5fc-kjzlg\" (UID: \"2f437c8b-8951-4760-a146-c28a25307841\") " pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:25.706837 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.706797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f437c8b-8951-4760-a146-c28a25307841-tls-certs\") pod \"model-serving-api-54d89bd5fc-kjzlg\" (UID: \"2f437c8b-8951-4760-a146-c28a25307841\") " pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:25.707032 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.706956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-cert\") pod \"odh-model-controller-7998c67dc4-gqbj2\" (UID: \"9c04e1f4-0c2c-42d4-86c3-c3372a52a886\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.707095 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.707037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfvv\" (UniqueName: \"kubernetes.io/projected/2f437c8b-8951-4760-a146-c28a25307841-kube-api-access-lxfvv\") pod \"model-serving-api-54d89bd5fc-kjzlg\" (UID: \"2f437c8b-8951-4760-a146-c28a25307841\") " pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:25.707408 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:31:25.707388 2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 09 02:31:25.707467 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:31:25.707453 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f437c8b-8951-4760-a146-c28a25307841-tls-certs podName:2f437c8b-8951-4760-a146-c28a25307841 nodeName:}" failed. No retries permitted until 2026-09-09 02:31:26.207435295 +0000 UTC m=+348.868971364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f437c8b-8951-4760-a146-c28a25307841-tls-certs") pod "model-serving-api-54d89bd5fc-kjzlg" (UID: "2f437c8b-8951-4760-a146-c28a25307841") : secret "model-serving-api-tls" not found Sep 09 02:31:25.710442 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.710418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c04e1f4-0c2c-42d4-86c3-c3372a52a886-cert\") pod \"odh-model-controller-7998c67dc4-gqbj2\" (UID: \"9c04e1f4-0c2c-42d4-86c3-c3372a52a886\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:25.716224 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.716194 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfvv\" (UniqueName: \"kubernetes.io/projected/2f437c8b-8951-4760-a146-c28a25307841-kube-api-access-lxfvv\") pod \"model-serving-api-54d89bd5fc-kjzlg\" (UID: \"2f437c8b-8951-4760-a146-c28a25307841\") " pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:25.989037 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:25.988986 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:26.212034 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:26.211997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f437c8b-8951-4760-a146-c28a25307841-tls-certs\") pod \"model-serving-api-54d89bd5fc-kjzlg\" (UID: \"2f437c8b-8951-4760-a146-c28a25307841\") " pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:26.214441 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:26.214411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f437c8b-8951-4760-a146-c28a25307841-tls-certs\") pod \"model-serving-api-54d89bd5fc-kjzlg\" (UID: \"2f437c8b-8951-4760-a146-c28a25307841\") " pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:26.269968 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:26.269867 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gqbj2"] Sep 09 02:31:26.273353 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:31:26.273322 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c04e1f4_0c2c_42d4_86c3_c3372a52a886.slice/crio-e16427da6d12fb6ee6c9422ea10778063d3b67e5454383ed8357e6666610287c WatchSource:0}: Error finding container e16427da6d12fb6ee6c9422ea10778063d3b67e5454383ed8357e6666610287c: Status 404 returned error can't find the container with id e16427da6d12fb6ee6c9422ea10778063d3b67e5454383ed8357e6666610287c Sep 09 02:31:26.325006 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:26.324963 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" event={"ID":"9c04e1f4-0c2c-42d4-86c3-c3372a52a886","Type":"ContainerStarted","Data":"e16427da6d12fb6ee6c9422ea10778063d3b67e5454383ed8357e6666610287c"} Sep 09 02:31:26.445631 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:26.445592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:26.717908 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:26.717875 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kjzlg"] Sep 09 02:31:26.720526 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:31:26.720497 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f437c8b_8951_4760_a146_c28a25307841.slice/crio-62bd513fb0078e0706809031d2bc4c24629d286c35c8228465652b17313ef46d WatchSource:0}: Error finding container 62bd513fb0078e0706809031d2bc4c24629d286c35c8228465652b17313ef46d: Status 404 returned error can't find the container with id 62bd513fb0078e0706809031d2bc4c24629d286c35c8228465652b17313ef46d Sep 09 02:31:27.336125 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:27.336041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" event={"ID":"2f437c8b-8951-4760-a146-c28a25307841","Type":"ContainerStarted","Data":"62bd513fb0078e0706809031d2bc4c24629d286c35c8228465652b17313ef46d"} Sep 09 02:31:30.095676 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.095587 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 02:31:30.095676 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.095633 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 02:31:30.095676 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.095666 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 02:31:30.096152 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.095695 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 02:31:30.096152 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.095724 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 02:31:30.096152 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.095772 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 02:31:30.353334 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.353191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" event={"ID":"72b699a2-2cdb-427c-9879-a019a7a23968","Type":"ContainerStarted","Data":"5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972"} Sep 09 02:31:30.355459 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.355351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" event={"ID":"9c04e1f4-0c2c-42d4-86c3-c3372a52a886","Type":"ContainerStarted","Data":"7cfc06f86e6629e4bf8c1277a23c9a233002af438315511ecfb1842a506d2886"} Sep 09 02:31:30.355602 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.355460 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:30.357065 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.357039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" event={"ID":"4810b94b-b57f-4ee9-b170-4fe7b56f0d0c","Type":"ContainerStarted","Data":"49295f5f01fbc0889a9400a0f88862a487223da4490694ef62d43d5f188118f3"} Sep 09 02:31:30.358852 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.358812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" event={"ID":"2f437c8b-8951-4760-a146-c28a25307841","Type":"ContainerStarted","Data":"e863d9743ee53410b49eb6d394266e4ae05358765f1ba6967acb03d42ceb1123"} Sep 09 02:31:30.358988 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.358971 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:30.381110 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.381055 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" podStartSLOduration=1.5633850489999999 podStartE2EDuration="7.381038541s" totalImagesPullingTime="5.817653492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:30.379503173 +0000 UTC m=+353.041039271" watchObservedRunningTime="2026-09-09 02:31:30.381038541 +0000 UTC m=+353.042574614" Sep 09 02:31:30.396037 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.395989 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" podStartSLOduration=1.560629273 podStartE2EDuration="5.395971879s" totalImagesPullingTime="3.835342606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:30.395500063 +0000 UTC m=+353.057036140" watchObservedRunningTime="2026-09-09 02:31:30.395971879 +0000 UTC m=+353.057507952" Sep 09 02:31:30.409476 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.409432 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" podStartSLOduration=2.031946866 podStartE2EDuration="5.4094136s" totalImagesPullingTime="3.377466734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:30.408766499 +0000 UTC m=+353.070302568" watchObservedRunningTime="2026-09-09 02:31:30.4094136 +0000 UTC m=+353.070949675" Sep 09 02:31:30.430072 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:30.430016 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" podStartSLOduration=1.872731529 podStartE2EDuration="7.430002446s" totalImagesPullingTime="5.557270917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:30.427761499 +0000 UTC m=+353.089297586" watchObservedRunningTime="2026-09-09 02:31:30.430002446 +0000 UTC m=+353.091538520" Sep 09 02:31:31.003543 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.003505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:31.005095 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.005063 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Sep 09 02:31:31.005226 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.005116 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Sep 09 02:31:31.259881 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.259769 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:31.264479 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.264449 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:31.363279 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.363231 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:31.363894 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.363877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r" Sep 09 02:31:31.418907 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:31.418874 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw"] Sep 09 02:31:32.004126 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:32.004088 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Sep 09 02:31:32.004322 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:32.004167 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Sep 09 02:31:33.003640 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.003605 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Sep 09 02:31:33.004064 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.003664 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Sep 09 02:31:33.374623 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.374582 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" containerName="istio-proxy" containerID="cri-o://5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972" gracePeriod=30 Sep 09 02:31:33.376039 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.376007 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl"] Sep 09 02:31:33.379689 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.379665 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.382714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.382323 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hjhvn\"" Sep 09 02:31:33.382714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.382338 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 02:31:33.382714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.382573 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 02:31:33.385399 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.383451 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 02:31:33.385399 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.383701 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 02:31:33.385399 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.383872 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 02:31:33.386357 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.386227 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl"] Sep 09 02:31:33.480495 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.480463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-cert\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.480685 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.480547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-metrics-cert\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.480763 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.480739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-manager-config\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.480818 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.480787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb627\" (UniqueName: \"kubernetes.io/projected/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-kube-api-access-bb627\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.581970 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.581909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-metrics-cert\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.582145 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.581988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-manager-config\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.582145 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.582009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb627\" (UniqueName: \"kubernetes.io/projected/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-kube-api-access-bb627\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.582145 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.582065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-cert\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.582702 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.582676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-manager-config\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.584624 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.584602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-metrics-cert\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.584710 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.584625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-cert\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.594489 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.594465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb627\" (UniqueName: \"kubernetes.io/projected/9e56a2d7-3c75-40a6-b278-496bd30dfa6e-kube-api-access-bb627\") pod \"lws-controller-manager-5cf499d5f9-5bdgl\" (UID: \"9e56a2d7-3c75-40a6-b278-496bd30dfa6e\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.692080 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.691990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:33.993847 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:33.993820 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl"] Sep 09 02:31:33.995593 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:31:33.995559 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e56a2d7_3c75_40a6_b278_496bd30dfa6e.slice/crio-ee89554e2bcafedb258ca84abb30dffee7f7d2a592c49b08de5a7753b1f25ffd WatchSource:0}: Error finding container ee89554e2bcafedb258ca84abb30dffee7f7d2a592c49b08de5a7753b1f25ffd: Status 404 returned error can't find the container with id ee89554e2bcafedb258ca84abb30dffee7f7d2a592c49b08de5a7753b1f25ffd Sep 09 02:31:34.380396 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:34.380354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" event={"ID":"9e56a2d7-3c75-40a6-b278-496bd30dfa6e","Type":"ContainerStarted","Data":"ee89554e2bcafedb258ca84abb30dffee7f7d2a592c49b08de5a7753b1f25ffd"} Sep 09 02:31:37.396365 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:37.396316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" event={"ID":"9e56a2d7-3c75-40a6-b278-496bd30dfa6e","Type":"ContainerStarted","Data":"9c3e684421c9cc837e25d8575c2ae37980d571d4c2e796cbba4552a94f8a6d15"} Sep 09 02:31:37.396751 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:37.396456 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:31:37.413184 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:37.413131 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" podStartSLOduration=1.109102087 podStartE2EDuration="4.413113833s" totalImagesPullingTime="3.304011746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:37.411592717 +0000 UTC m=+360.073128790" watchObservedRunningTime="2026-09-09 02:31:37.413113833 +0000 UTC m=+360.074649907" Sep 09 02:31:38.629074 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.629046 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:38.726776 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726694 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-socket\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.726776 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726729 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-envoy\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.726776 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726773 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b699a2-2cdb-427c-9879-a019a7a23968-istio-podinfo\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.727094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726809 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-certs\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.727094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726829 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-istio-token\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.727094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726843 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-credential-socket\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.727094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726879 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b699a2-2cdb-427c-9879-a019a7a23968-istiod-ca-cert\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.727094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726917 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77w9x\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-kube-api-access-77w9x\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.727094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.726975 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-data\") pod \"72b699a2-2cdb-427c-9879-a019a7a23968\" (UID: \"72b699a2-2cdb-427c-9879-a019a7a23968\") " Sep 09 02:31:38.727094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727021 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:31:38.727418 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727164 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:31:38.727418 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727175 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:31:38.727418 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727262 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-certs\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.727418 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727280 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-credential-socket\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.727418 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727295 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-workload-socket\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.727418 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727384 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-data" (OuterVolumeSpecName: "istio-data") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:31:38.727703 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.727450 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72b699a2-2cdb-427c-9879-a019a7a23968-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:31:38.729278 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.729248 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:31:38.729401 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.729284 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-kube-api-access-77w9x" (OuterVolumeSpecName: "kube-api-access-77w9x") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "kube-api-access-77w9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:31:38.729505 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.729490 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72b699a2-2cdb-427c-9879-a019a7a23968-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 09 02:31:38.729563 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.729523 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-istio-token" (OuterVolumeSpecName: "istio-token") pod "72b699a2-2cdb-427c-9879-a019a7a23968" (UID: "72b699a2-2cdb-427c-9879-a019a7a23968"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:31:38.828260 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.828207 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b699a2-2cdb-427c-9879-a019a7a23968-istio-podinfo\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.828260 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.828253 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-istio-token\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.828260 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.828262 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b699a2-2cdb-427c-9879-a019a7a23968-istiod-ca-cert\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.828260 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.828270 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77w9x\" (UniqueName: \"kubernetes.io/projected/72b699a2-2cdb-427c-9879-a019a7a23968-kube-api-access-77w9x\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.828260 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.828279 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-data\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:38.828570 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:38.828286 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b699a2-2cdb-427c-9879-a019a7a23968-istio-envoy\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:31:39.406362 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.406328 2581 generic.go:356] "Generic (PLEG): container finished" podID="72b699a2-2cdb-427c-9879-a019a7a23968" containerID="5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972" exitCode=0 Sep 09 02:31:39.406501 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.406376 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" Sep 09 02:31:39.406501 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.406414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" event={"ID":"72b699a2-2cdb-427c-9879-a019a7a23968","Type":"ContainerDied","Data":"5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972"} Sep 09 02:31:39.406501 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.406470 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw" event={"ID":"72b699a2-2cdb-427c-9879-a019a7a23968","Type":"ContainerDied","Data":"0a9f60869620ad6b37e7630009d00ca18a967940a338544a3a626ed4e2ebf7de"} Sep 09 02:31:39.406613 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.406500 2581 scope.go:117] "RemoveContainer" containerID="5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972" Sep 09 02:31:39.415822 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.415800 2581 scope.go:117] "RemoveContainer" containerID="5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972" Sep 09 02:31:39.416133 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:31:39.416112 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972\": container with ID starting with 5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972 not found: ID does not exist" containerID="5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972" Sep 09 02:31:39.416190 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.416142 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972"} err="failed to get container status \"5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972\": rpc error: code = NotFound desc = could not find container \"5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972\": container with ID starting with 5d7edfb74055ad579a740ede4d81f1951e94fa592ea8ceff03a9af4069ec0972 not found: ID does not exist" Sep 09 02:31:39.438641 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.438605 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw"] Sep 09 02:31:39.452591 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.452567 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-jl4qw"] Sep 09 02:31:39.845526 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:39.845494 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" path="/var/lib/kubelet/pods/72b699a2-2cdb-427c-9879-a019a7a23968/volumes" Sep 09 02:31:41.366007 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:41.365977 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gqbj2" Sep 09 02:31:41.367818 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:41.367798 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-kjzlg" Sep 09 02:31:48.403033 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:31:48.403000 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-5bdgl" Sep 09 02:32:29.901745 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.901709 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z"] Sep 09 02:32:29.902217 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.902036 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" containerName="istio-proxy" Sep 09 02:32:29.902217 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.902049 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" containerName="istio-proxy" Sep 09 02:32:29.902217 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.902105 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72b699a2-2cdb-427c-9879-a019a7a23968" containerName="istio-proxy" Sep 09 02:32:29.904144 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.904128 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:29.906589 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.906559 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 02:32:29.906745 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.906621 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r6g5j\"" Sep 09 02:32:29.906745 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.906632 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 02:32:29.912496 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.912473 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z"] Sep 09 02:32:29.960258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.960226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bth66\" (UniqueName: \"kubernetes.io/projected/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-kube-api-access-bth66\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:29.960411 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.960267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:29.960411 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:29.960357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.003420 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.003384 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86"] Sep 09 02:32:30.005595 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.005578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.013841 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.013807 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86"] Sep 09 02:32:30.060776 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.060737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bth66\" (UniqueName: \"kubernetes.io/projected/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-kube-api-access-bth66\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.060966 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.060784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.060966 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.060906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.061069 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.060971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.061069 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.061030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85q75\" (UniqueName: \"kubernetes.io/projected/8741abb5-33c5-4ae0-aace-a2eed74d3893-kube-api-access-85q75\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.061069 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.061062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.061217 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.061137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.061360 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.061340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.068411 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.068380 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bth66\" (UniqueName: \"kubernetes.io/projected/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-kube-api-access-bth66\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.102291 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.102254 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc"] Sep 09 02:32:30.107347 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.107320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.111298 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.111275 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc"] Sep 09 02:32:30.161856 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.161780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.161856 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.161825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.162084 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.161872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85q75\" (UniqueName: \"kubernetes.io/projected/8741abb5-33c5-4ae0-aace-a2eed74d3893-kube-api-access-85q75\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.162084 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.161949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg26r\" (UniqueName: \"kubernetes.io/projected/a240e337-6af0-4906-9775-a87058fefc74-kube-api-access-bg26r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.162084 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.161982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.162084 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.162016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.162297 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.162182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.162297 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.162248 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.170272 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.170252 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85q75\" (UniqueName: \"kubernetes.io/projected/8741abb5-33c5-4ae0-aace-a2eed74d3893-kube-api-access-85q75\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.205048 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.205019 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr"] Sep 09 02:32:30.207609 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.207590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.213554 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.213528 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:30.215775 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.215567 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr"] Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.263427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.263542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg26r\" (UniqueName: \"kubernetes.io/projected/a240e337-6af0-4906-9775-a87058fefc74-kube-api-access-bg26r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.263595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.264020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.264024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.264130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7tjp\" (UniqueName: \"kubernetes.io/projected/751da900-fc8b-44f3-9e2b-78dcb1888913-kube-api-access-d7tjp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.264237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.264803 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.264271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.275231 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.275152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg26r\" (UniqueName: \"kubernetes.io/projected/a240e337-6af0-4906-9775-a87058fefc74-kube-api-access-bg26r\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.315855 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.315813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:30.366023 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.364951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7tjp\" (UniqueName: \"kubernetes.io/projected/751da900-fc8b-44f3-9e2b-78dcb1888913-kube-api-access-d7tjp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.366023 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.365030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.366023 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.365538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.366023 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.365908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.366023 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.365995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.375174 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.375148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7tjp\" (UniqueName: \"kubernetes.io/projected/751da900-fc8b-44f3-9e2b-78dcb1888913-kube-api-access-d7tjp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.418110 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.418031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:30.487283 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.486934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z"] Sep 09 02:32:30.490680 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:32:30.490654 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824c5cbb_b111_4c2e_a58d_1d7f8e70bda2.slice/crio-1bd4b317d540f29c233832ba3607afbd6f534fbd638e5523670ebeae3e00cc25 WatchSource:0}: Error finding container 1bd4b317d540f29c233832ba3607afbd6f534fbd638e5523670ebeae3e00cc25: Status 404 returned error can't find the container with id 1bd4b317d540f29c233832ba3607afbd6f534fbd638e5523670ebeae3e00cc25 Sep 09 02:32:30.517150 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.517131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:30.586147 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.586118 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86"] Sep 09 02:32:30.588130 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:32:30.588094 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8741abb5_33c5_4ae0_aace_a2eed74d3893.slice/crio-12be4dcc0986d7034d3a321b079c268cb6c5be8892f6d9ddf0192fabe83d0898 WatchSource:0}: Error finding container 12be4dcc0986d7034d3a321b079c268cb6c5be8892f6d9ddf0192fabe83d0898: Status 404 returned error can't find the container with id 12be4dcc0986d7034d3a321b079c268cb6c5be8892f6d9ddf0192fabe83d0898 Sep 09 02:32:30.640770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.640742 2581 generic.go:356] "Generic (PLEG): container finished" podID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerID="a01beaa37b0f446a5b572adf1f1ef615611d5c6b4e6192744df2efc56e061051" exitCode=0 Sep 09 02:32:30.640912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.640819 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" event={"ID":"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2","Type":"ContainerDied","Data":"a01beaa37b0f446a5b572adf1f1ef615611d5c6b4e6192744df2efc56e061051"} Sep 09 02:32:30.640912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.640872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" event={"ID":"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2","Type":"ContainerStarted","Data":"1bd4b317d540f29c233832ba3607afbd6f534fbd638e5523670ebeae3e00cc25"} Sep 09 02:32:30.642179 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.642148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" event={"ID":"8741abb5-33c5-4ae0-aace-a2eed74d3893","Type":"ContainerStarted","Data":"12be4dcc0986d7034d3a321b079c268cb6c5be8892f6d9ddf0192fabe83d0898"} Sep 09 02:32:30.685435 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.685403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc"] Sep 09 02:32:30.686284 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:32:30.686260 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda240e337_6af0_4906_9775_a87058fefc74.slice/crio-b068bcc96848db7c00e178b3500359efeeadc8e847701680a8afdcb4111bd1bc WatchSource:0}: Error finding container b068bcc96848db7c00e178b3500359efeeadc8e847701680a8afdcb4111bd1bc: Status 404 returned error can't find the container with id b068bcc96848db7c00e178b3500359efeeadc8e847701680a8afdcb4111bd1bc Sep 09 02:32:30.789577 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:30.789554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr"] Sep 09 02:32:30.850730 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:32:30.850693 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751da900_fc8b_44f3_9e2b_78dcb1888913.slice/crio-92d2627ad0c206965d8e614b1f588691e715aaaa8d5f5dc9a652b7ef6cf26462 WatchSource:0}: Error finding container 92d2627ad0c206965d8e614b1f588691e715aaaa8d5f5dc9a652b7ef6cf26462: Status 404 returned error can't find the container with id 92d2627ad0c206965d8e614b1f588691e715aaaa8d5f5dc9a652b7ef6cf26462 Sep 09 02:32:31.648721 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.648635 2581 generic.go:356] "Generic (PLEG): container finished" podID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerID="fbbb994430bd9cdaf22e44c372bbfc81f5c77e79b306b2e32ec06cb85189fae7" exitCode=0 Sep 09 02:32:31.648721 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.648684 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" event={"ID":"751da900-fc8b-44f3-9e2b-78dcb1888913","Type":"ContainerDied","Data":"fbbb994430bd9cdaf22e44c372bbfc81f5c77e79b306b2e32ec06cb85189fae7"} Sep 09 02:32:31.649212 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.648736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" event={"ID":"751da900-fc8b-44f3-9e2b-78dcb1888913","Type":"ContainerStarted","Data":"92d2627ad0c206965d8e614b1f588691e715aaaa8d5f5dc9a652b7ef6cf26462"} Sep 09 02:32:31.650445 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.650426 2581 generic.go:356] "Generic (PLEG): container finished" podID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerID="990b77cc6cf4873647724085a069495d1ccae7858e3011eab35728d1e1fc3348" exitCode=0 Sep 09 02:32:31.650540 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.650500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" event={"ID":"8741abb5-33c5-4ae0-aace-a2eed74d3893","Type":"ContainerDied","Data":"990b77cc6cf4873647724085a069495d1ccae7858e3011eab35728d1e1fc3348"} Sep 09 02:32:31.652201 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.652180 2581 generic.go:356] "Generic (PLEG): container finished" podID="a240e337-6af0-4906-9775-a87058fefc74" containerID="e23f6ae573913002afc75f3b3d9747ac2bd8ac8110ebecb301c8ce5be5f8b0f4" exitCode=0 Sep 09 02:32:31.652314 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.652206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" event={"ID":"a240e337-6af0-4906-9775-a87058fefc74","Type":"ContainerDied","Data":"e23f6ae573913002afc75f3b3d9747ac2bd8ac8110ebecb301c8ce5be5f8b0f4"} Sep 09 02:32:31.652314 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.652246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" event={"ID":"a240e337-6af0-4906-9775-a87058fefc74","Type":"ContainerStarted","Data":"b068bcc96848db7c00e178b3500359efeeadc8e847701680a8afdcb4111bd1bc"} Sep 09 02:32:31.654393 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.654374 2581 generic.go:356] "Generic (PLEG): container finished" podID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerID="ec3968036708e834cff22f3fef3445fe3c4495ec605dbc112624cfcd1c13a2a1" exitCode=0 Sep 09 02:32:31.654466 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:31.654405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" event={"ID":"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2","Type":"ContainerDied","Data":"ec3968036708e834cff22f3fef3445fe3c4495ec605dbc112624cfcd1c13a2a1"} Sep 09 02:32:32.661989 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.661951 2581 generic.go:356] "Generic (PLEG): container finished" podID="a240e337-6af0-4906-9775-a87058fefc74" containerID="4a2bdad4e03ba9ad85f6c5f48297b3458439e51317e0ca0c0796164f9e72c643" exitCode=0 Sep 09 02:32:32.662397 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.662064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" event={"ID":"a240e337-6af0-4906-9775-a87058fefc74","Type":"ContainerDied","Data":"4a2bdad4e03ba9ad85f6c5f48297b3458439e51317e0ca0c0796164f9e72c643"} Sep 09 02:32:32.664243 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.664220 2581 generic.go:356] "Generic (PLEG): container finished" podID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerID="07ff8fb0438919bf68e1941278dd5202465ce4695e49d77be25f6732d4bb9a08" exitCode=0 Sep 09 02:32:32.664333 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.664298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" event={"ID":"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2","Type":"ContainerDied","Data":"07ff8fb0438919bf68e1941278dd5202465ce4695e49d77be25f6732d4bb9a08"} Sep 09 02:32:32.666106 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.666085 2581 generic.go:356] "Generic (PLEG): container finished" podID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerID="24fc66eded395a145ba5abf106bda67b1d675d9b37ca17e9c0e0b1489b8b1056" exitCode=0 Sep 09 02:32:32.666174 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.666152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" event={"ID":"751da900-fc8b-44f3-9e2b-78dcb1888913","Type":"ContainerDied","Data":"24fc66eded395a145ba5abf106bda67b1d675d9b37ca17e9c0e0b1489b8b1056"} Sep 09 02:32:32.668150 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.668135 2581 generic.go:356] "Generic (PLEG): container finished" podID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerID="f86b9b9b6fa6653513e23be146a597f49f6ebc439ee5b12d4378162bc64d704b" exitCode=0 Sep 09 02:32:32.668230 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:32.668163 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" event={"ID":"8741abb5-33c5-4ae0-aace-a2eed74d3893","Type":"ContainerDied","Data":"f86b9b9b6fa6653513e23be146a597f49f6ebc439ee5b12d4378162bc64d704b"} Sep 09 02:32:33.674980 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.674942 2581 generic.go:356] "Generic (PLEG): container finished" podID="a240e337-6af0-4906-9775-a87058fefc74" containerID="42aa47f0d3b283f53370d2154ae75af37de67d5630de64e56b27d87171ba2b37" exitCode=0 Sep 09 02:32:33.675446 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.675018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" event={"ID":"a240e337-6af0-4906-9775-a87058fefc74","Type":"ContainerDied","Data":"42aa47f0d3b283f53370d2154ae75af37de67d5630de64e56b27d87171ba2b37"} Sep 09 02:32:33.677132 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.677110 2581 generic.go:356] "Generic (PLEG): container finished" podID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerID="2f337d24ea07c456a7b4af688a231ede092ed925fd2e0eb2da179995f9e88d28" exitCode=0 Sep 09 02:32:33.677245 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.677182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" event={"ID":"751da900-fc8b-44f3-9e2b-78dcb1888913","Type":"ContainerDied","Data":"2f337d24ea07c456a7b4af688a231ede092ed925fd2e0eb2da179995f9e88d28"} Sep 09 02:32:33.679316 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.679295 2581 generic.go:356] "Generic (PLEG): container finished" podID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerID="9b093db9468bcd7a5f098d572668a5403f0eae4d507aed4b06c920acbf3ee888" exitCode=0 Sep 09 02:32:33.679401 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.679364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" event={"ID":"8741abb5-33c5-4ae0-aace-a2eed74d3893","Type":"ContainerDied","Data":"9b093db9468bcd7a5f098d572668a5403f0eae4d507aed4b06c920acbf3ee888"} Sep 09 02:32:33.810334 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.810311 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:33.898364 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.898331 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bth66\" (UniqueName: \"kubernetes.io/projected/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-kube-api-access-bth66\") pod \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " Sep 09 02:32:33.898513 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.898419 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-util\") pod \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " Sep 09 02:32:33.898513 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.898447 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-bundle\") pod \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\" (UID: \"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2\") " Sep 09 02:32:33.898944 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.898899 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-bundle" (OuterVolumeSpecName: "bundle") pod "824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" (UID: "824c5cbb-b111-4c2e-a58d-1d7f8e70bda2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:33.900427 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.900397 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-kube-api-access-bth66" (OuterVolumeSpecName: "kube-api-access-bth66") pod "824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" (UID: "824c5cbb-b111-4c2e-a58d-1d7f8e70bda2"). InnerVolumeSpecName "kube-api-access-bth66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:32:33.903715 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.903687 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-util" (OuterVolumeSpecName: "util") pod "824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" (UID: "824c5cbb-b111-4c2e-a58d-1d7f8e70bda2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:34.000049 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.999965 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:34.000049 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:33.999994 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:34.000049 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.000003 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bth66\" (UniqueName: \"kubernetes.io/projected/824c5cbb-b111-4c2e-a58d-1d7f8e70bda2-kube-api-access-bth66\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:34.685606 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.685578 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" Sep 09 02:32:34.686042 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.685622 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hwz9z" event={"ID":"824c5cbb-b111-4c2e-a58d-1d7f8e70bda2","Type":"ContainerDied","Data":"1bd4b317d540f29c233832ba3607afbd6f534fbd638e5523670ebeae3e00cc25"} Sep 09 02:32:34.686042 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.685675 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bd4b317d540f29c233832ba3607afbd6f534fbd638e5523670ebeae3e00cc25" Sep 09 02:32:34.816773 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.816748 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:34.875468 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.875444 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:34.878425 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.878404 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:34.908042 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.908016 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-util\") pod \"a240e337-6af0-4906-9775-a87058fefc74\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " Sep 09 02:32:34.908199 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.908084 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg26r\" (UniqueName: \"kubernetes.io/projected/a240e337-6af0-4906-9775-a87058fefc74-kube-api-access-bg26r\") pod \"a240e337-6af0-4906-9775-a87058fefc74\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " Sep 09 02:32:34.908199 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.908133 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-bundle\") pod \"a240e337-6af0-4906-9775-a87058fefc74\" (UID: \"a240e337-6af0-4906-9775-a87058fefc74\") " Sep 09 02:32:34.910325 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.909798 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-bundle" (OuterVolumeSpecName: "bundle") pod "a240e337-6af0-4906-9775-a87058fefc74" (UID: "a240e337-6af0-4906-9775-a87058fefc74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:34.910801 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.910770 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a240e337-6af0-4906-9775-a87058fefc74-kube-api-access-bg26r" (OuterVolumeSpecName: "kube-api-access-bg26r") pod "a240e337-6af0-4906-9775-a87058fefc74" (UID: "a240e337-6af0-4906-9775-a87058fefc74"). InnerVolumeSpecName "kube-api-access-bg26r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:32:34.915185 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:34.915162 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-util" (OuterVolumeSpecName: "util") pod "a240e337-6af0-4906-9775-a87058fefc74" (UID: "a240e337-6af0-4906-9775-a87058fefc74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:35.008671 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.008582 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-bundle\") pod \"8741abb5-33c5-4ae0-aace-a2eed74d3893\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " Sep 09 02:32:35.008671 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.008645 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-bundle\") pod \"751da900-fc8b-44f3-9e2b-78dcb1888913\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " Sep 09 02:32:35.008880 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.008697 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-util\") pod \"751da900-fc8b-44f3-9e2b-78dcb1888913\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " Sep 09 02:32:35.008880 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.008722 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7tjp\" (UniqueName: \"kubernetes.io/projected/751da900-fc8b-44f3-9e2b-78dcb1888913-kube-api-access-d7tjp\") pod \"751da900-fc8b-44f3-9e2b-78dcb1888913\" (UID: \"751da900-fc8b-44f3-9e2b-78dcb1888913\") " Sep 09 02:32:35.008880 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.008774 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85q75\" (UniqueName: \"kubernetes.io/projected/8741abb5-33c5-4ae0-aace-a2eed74d3893-kube-api-access-85q75\") pod \"8741abb5-33c5-4ae0-aace-a2eed74d3893\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " Sep 09 02:32:35.008880 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.008835 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-util\") pod \"8741abb5-33c5-4ae0-aace-a2eed74d3893\" (UID: \"8741abb5-33c5-4ae0-aace-a2eed74d3893\") " Sep 09 02:32:35.009107 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.009069 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.009107 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.009088 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a240e337-6af0-4906-9775-a87058fefc74-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.009107 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.009101 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg26r\" (UniqueName: \"kubernetes.io/projected/a240e337-6af0-4906-9775-a87058fefc74-kube-api-access-bg26r\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.009311 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.009279 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-bundle" (OuterVolumeSpecName: "bundle") pod "8741abb5-33c5-4ae0-aace-a2eed74d3893" (UID: "8741abb5-33c5-4ae0-aace-a2eed74d3893"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:35.009504 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.009481 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-bundle" (OuterVolumeSpecName: "bundle") pod "751da900-fc8b-44f3-9e2b-78dcb1888913" (UID: "751da900-fc8b-44f3-9e2b-78dcb1888913"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:35.011530 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.011508 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751da900-fc8b-44f3-9e2b-78dcb1888913-kube-api-access-d7tjp" (OuterVolumeSpecName: "kube-api-access-d7tjp") pod "751da900-fc8b-44f3-9e2b-78dcb1888913" (UID: "751da900-fc8b-44f3-9e2b-78dcb1888913"). InnerVolumeSpecName "kube-api-access-d7tjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:32:35.011604 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.011540 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8741abb5-33c5-4ae0-aace-a2eed74d3893-kube-api-access-85q75" (OuterVolumeSpecName: "kube-api-access-85q75") pod "8741abb5-33c5-4ae0-aace-a2eed74d3893" (UID: "8741abb5-33c5-4ae0-aace-a2eed74d3893"). InnerVolumeSpecName "kube-api-access-85q75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:32:35.014457 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.014418 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-util" (OuterVolumeSpecName: "util") pod "8741abb5-33c5-4ae0-aace-a2eed74d3893" (UID: "8741abb5-33c5-4ae0-aace-a2eed74d3893"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:35.014566 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.014549 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-util" (OuterVolumeSpecName: "util") pod "751da900-fc8b-44f3-9e2b-78dcb1888913" (UID: "751da900-fc8b-44f3-9e2b-78dcb1888913"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:32:35.109992 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.109962 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.109992 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.109985 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8741abb5-33c5-4ae0-aace-a2eed74d3893-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.109992 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.109994 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-bundle\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.109992 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.110001 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/751da900-fc8b-44f3-9e2b-78dcb1888913-util\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.110226 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.110010 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7tjp\" (UniqueName: \"kubernetes.io/projected/751da900-fc8b-44f3-9e2b-78dcb1888913-kube-api-access-d7tjp\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.110226 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.110020 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85q75\" (UniqueName: \"kubernetes.io/projected/8741abb5-33c5-4ae0-aace-a2eed74d3893-kube-api-access-85q75\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:32:35.695957 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.695912 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" Sep 09 02:32:35.695957 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.695939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agb2wr" event={"ID":"751da900-fc8b-44f3-9e2b-78dcb1888913","Type":"ContainerDied","Data":"92d2627ad0c206965d8e614b1f588691e715aaaa8d5f5dc9a652b7ef6cf26462"} Sep 09 02:32:35.696459 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.696018 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92d2627ad0c206965d8e614b1f588691e715aaaa8d5f5dc9a652b7ef6cf26462" Sep 09 02:32:35.698101 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.698081 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" Sep 09 02:32:35.698221 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.698083 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7ftz86" event={"ID":"8741abb5-33c5-4ae0-aace-a2eed74d3893","Type":"ContainerDied","Data":"12be4dcc0986d7034d3a321b079c268cb6c5be8892f6d9ddf0192fabe83d0898"} Sep 09 02:32:35.698221 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.698201 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12be4dcc0986d7034d3a321b079c268cb6c5be8892f6d9ddf0192fabe83d0898" Sep 09 02:32:35.700148 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.700124 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" Sep 09 02:32:35.700254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.700153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8nlwc" event={"ID":"a240e337-6af0-4906-9775-a87058fefc74","Type":"ContainerDied","Data":"b068bcc96848db7c00e178b3500359efeeadc8e847701680a8afdcb4111bd1bc"} Sep 09 02:32:35.700254 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:32:35.700191 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b068bcc96848db7c00e178b3500359efeeadc8e847701680a8afdcb4111bd1bc" Sep 09 02:33:52.407480 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407445 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-76m9q"] Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407728 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407739 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407748 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407753 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407763 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407770 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407775 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407780 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407787 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a240e337-6af0-4906-9775-a87058fefc74" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407792 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a240e337-6af0-4906-9775-a87058fefc74" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407801 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407806 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407811 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a240e337-6af0-4906-9775-a87058fefc74" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407816 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a240e337-6af0-4906-9775-a87058fefc74" containerName="pull" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407823 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407829 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407837 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407842 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407847 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407852 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407860 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a240e337-6af0-4906-9775-a87058fefc74" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407865 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a240e337-6af0-4906-9775-a87058fefc74" containerName="util" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407872 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407877 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407939 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a240e337-6af0-4906-9775-a87058fefc74" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407949 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="824c5cbb-b111-4c2e-a58d-1d7f8e70bda2" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407964 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="751da900-fc8b-44f3-9e2b-78dcb1888913" containerName="extract" Sep 09 02:33:52.407971 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.407971 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8741abb5-33c5-4ae0-aace-a2eed74d3893" containerName="extract" Sep 09 02:33:52.410805 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.410788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" Sep 09 02:33:52.412960 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.412914 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 02:33:52.413092 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.412937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l9pnp\"" Sep 09 02:33:52.413092 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.412989 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 02:33:52.433538 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.433508 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-76m9q"] Sep 09 02:33:52.533542 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.533503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvqvm\" (UniqueName: \"kubernetes.io/projected/6109d6dc-d167-4b8f-a878-a778d1946676-kube-api-access-hvqvm\") pod \"authorino-7bcfd8f9cd-76m9q\" (UID: \"6109d6dc-d167-4b8f-a878-a778d1946676\") " pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" Sep 09 02:33:52.634898 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.634844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqvm\" (UniqueName: \"kubernetes.io/projected/6109d6dc-d167-4b8f-a878-a778d1946676-kube-api-access-hvqvm\") pod \"authorino-7bcfd8f9cd-76m9q\" (UID: \"6109d6dc-d167-4b8f-a878-a778d1946676\") " pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" Sep 09 02:33:52.642478 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.642453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvqvm\" (UniqueName: \"kubernetes.io/projected/6109d6dc-d167-4b8f-a878-a778d1946676-kube-api-access-hvqvm\") pod \"authorino-7bcfd8f9cd-76m9q\" (UID: \"6109d6dc-d167-4b8f-a878-a778d1946676\") " pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" Sep 09 02:33:52.719983 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.719866 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" Sep 09 02:33:52.987404 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:52.987377 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-76m9q"] Sep 09 02:33:52.989161 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:33:52.989131 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6109d6dc_d167_4b8f_a878_a778d1946676.slice/crio-30fd904434542358176fa0c0a71399ad3be93558ef0b6bde372d6210445ac512 WatchSource:0}: Error finding container 30fd904434542358176fa0c0a71399ad3be93558ef0b6bde372d6210445ac512: Status 404 returned error can't find the container with id 30fd904434542358176fa0c0a71399ad3be93558ef0b6bde372d6210445ac512 Sep 09 02:33:53.065256 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:53.065204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" event={"ID":"6109d6dc-d167-4b8f-a878-a778d1946676","Type":"ContainerStarted","Data":"30fd904434542358176fa0c0a71399ad3be93558ef0b6bde372d6210445ac512"} Sep 09 02:33:56.002881 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:56.002850 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-76m9q"] Sep 09 02:33:56.085937 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:56.085888 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" event={"ID":"6109d6dc-d167-4b8f-a878-a778d1946676","Type":"ContainerStarted","Data":"a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319"} Sep 09 02:33:56.099810 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:56.099754 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" podStartSLOduration=1.3134250650000001 podStartE2EDuration="4.099736398s" totalImagesPullingTime="2.786311333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:33:56.099257634 +0000 UTC m=+498.760793710" watchObservedRunningTime="2026-09-09 02:33:56.099736398 +0000 UTC m=+498.761272513" Sep 09 02:33:57.090490 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:57.090451 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" podUID="6109d6dc-d167-4b8f-a878-a778d1946676" containerName="authorino" containerID="cri-o://a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319" gracePeriod=30 Sep 09 02:33:57.329988 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:57.329966 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" Sep 09 02:33:57.476645 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:57.476554 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvqvm\" (UniqueName: \"kubernetes.io/projected/6109d6dc-d167-4b8f-a878-a778d1946676-kube-api-access-hvqvm\") pod \"6109d6dc-d167-4b8f-a878-a778d1946676\" (UID: \"6109d6dc-d167-4b8f-a878-a778d1946676\") " Sep 09 02:33:57.478737 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:57.478713 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6109d6dc-d167-4b8f-a878-a778d1946676-kube-api-access-hvqvm" (OuterVolumeSpecName: "kube-api-access-hvqvm") pod "6109d6dc-d167-4b8f-a878-a778d1946676" (UID: "6109d6dc-d167-4b8f-a878-a778d1946676"). InnerVolumeSpecName "kube-api-access-hvqvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:33:57.577295 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:57.577263 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvqvm\" (UniqueName: \"kubernetes.io/projected/6109d6dc-d167-4b8f-a878-a778d1946676-kube-api-access-hvqvm\") on node \"ip-10-0-143-68.ec2.internal\" DevicePath \"\"" Sep 09 02:33:58.101139 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.101097 2581 generic.go:356] "Generic (PLEG): container finished" podID="6109d6dc-d167-4b8f-a878-a778d1946676" containerID="a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319" exitCode=0 Sep 09 02:33:58.101555 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.101151 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" Sep 09 02:33:58.101555 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.101174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" event={"ID":"6109d6dc-d167-4b8f-a878-a778d1946676","Type":"ContainerDied","Data":"a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319"} Sep 09 02:33:58.101555 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.101217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-76m9q" event={"ID":"6109d6dc-d167-4b8f-a878-a778d1946676","Type":"ContainerDied","Data":"30fd904434542358176fa0c0a71399ad3be93558ef0b6bde372d6210445ac512"} Sep 09 02:33:58.101555 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.101234 2581 scope.go:117] "RemoveContainer" containerID="a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319" Sep 09 02:33:58.109405 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.109384 2581 scope.go:117] "RemoveContainer" containerID="a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319" Sep 09 02:33:58.109697 ip-10-0-143-68 kubenswrapper[2581]: E0909 02:33:58.109673 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319\": container with ID starting with a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319 not found: ID does not exist" containerID="a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319" Sep 09 02:33:58.109796 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.109704 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319"} err="failed to get container status \"a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319\": rpc error: code = NotFound desc = could not find container \"a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319\": container with ID starting with a16e70882779738ba7b118d532b75ceb0627f37a7e9683baf2f9c19d45d45319 not found: ID does not exist" Sep 09 02:33:58.115841 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.115817 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-76m9q"] Sep 09 02:33:58.119231 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:58.119206 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-76m9q"] Sep 09 02:33:59.844827 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:33:59.844793 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6109d6dc-d167-4b8f-a878-a778d1946676" path="/var/lib/kubelet/pods/6109d6dc-d167-4b8f-a878-a778d1946676/volumes" Sep 09 02:35:02.580277 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.580236 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c"] Sep 09 02:35:02.580792 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.580540 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6109d6dc-d167-4b8f-a878-a778d1946676" containerName="authorino" Sep 09 02:35:02.580792 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.580554 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6109d6dc-d167-4b8f-a878-a778d1946676" containerName="authorino" Sep 09 02:35:02.580792 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.580633 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6109d6dc-d167-4b8f-a878-a778d1946676" containerName="authorino" Sep 09 02:35:02.583394 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.583377 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:02.585875 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.585853 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 02:35:02.586013 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.585942 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4chv6\"" Sep 09 02:35:02.593605 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.593580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c"] Sep 09 02:35:02.726684 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.726653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7bpk\" (UniqueName: \"kubernetes.io/projected/389b0e49-1058-4ae8-a64a-292d8ca77b93-kube-api-access-n7bpk\") pod \"payload-pre-processing-59fbc47bf8-jhp8c\" (UID: \"389b0e49-1058-4ae8-a64a-292d8ca77b93\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:02.726881 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.726785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389b0e49-1058-4ae8-a64a-292d8ca77b93-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jhp8c\" (UID: \"389b0e49-1058-4ae8-a64a-292d8ca77b93\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:02.828120 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.828082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389b0e49-1058-4ae8-a64a-292d8ca77b93-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jhp8c\" (UID: \"389b0e49-1058-4ae8-a64a-292d8ca77b93\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:02.828120 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.828129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7bpk\" (UniqueName: \"kubernetes.io/projected/389b0e49-1058-4ae8-a64a-292d8ca77b93-kube-api-access-n7bpk\") pod \"payload-pre-processing-59fbc47bf8-jhp8c\" (UID: \"389b0e49-1058-4ae8-a64a-292d8ca77b93\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:02.828779 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.828758 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/389b0e49-1058-4ae8-a64a-292d8ca77b93-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jhp8c\" (UID: \"389b0e49-1058-4ae8-a64a-292d8ca77b93\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:02.836343 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.836280 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7bpk\" (UniqueName: \"kubernetes.io/projected/389b0e49-1058-4ae8-a64a-292d8ca77b93-kube-api-access-n7bpk\") pod \"payload-pre-processing-59fbc47bf8-jhp8c\" (UID: \"389b0e49-1058-4ae8-a64a-292d8ca77b93\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:02.894538 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:02.894499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:03.162081 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:03.162051 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c"] Sep 09 02:35:03.163717 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:35:03.163679 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389b0e49_1058_4ae8_a64a_292d8ca77b93.slice/crio-21bacd956902487ba7d3de18c04e877fbbe384f663bd4d4cdbc6d168c7bc5410 WatchSource:0}: Error finding container 21bacd956902487ba7d3de18c04e877fbbe384f663bd4d4cdbc6d168c7bc5410: Status 404 returned error can't find the container with id 21bacd956902487ba7d3de18c04e877fbbe384f663bd4d4cdbc6d168c7bc5410 Sep 09 02:35:03.401375 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:03.401342 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" event={"ID":"389b0e49-1058-4ae8-a64a-292d8ca77b93","Type":"ContainerStarted","Data":"21bacd956902487ba7d3de18c04e877fbbe384f663bd4d4cdbc6d168c7bc5410"} Sep 09 02:35:05.413297 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:05.413264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" event={"ID":"389b0e49-1058-4ae8-a64a-292d8ca77b93","Type":"ContainerStarted","Data":"d03cbd991b2d6b8b996268d6d07c336e5c426f7f62415e5bc34172b2dfdd3862"} Sep 09 02:35:05.413687 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:05.413329 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:05.429674 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:05.429619 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" podStartSLOduration=1.79501759 podStartE2EDuration="3.429604584s" totalImagesPullingTime="1.634586994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:35:05.427996319 +0000 UTC m=+568.089532394" watchObservedRunningTime="2026-09-09 02:35:05.429604584 +0000 UTC m=+568.091140655" Sep 09 02:35:16.420153 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:16.420116 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jhp8c" Sep 09 02:35:37.798646 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:37.798618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:35:37.799075 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:35:37.798852 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:36:07.846842 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.846769 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b"] Sep 09 02:36:07.849906 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.849888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:07.853348 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.853128 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tp54s\"" Sep 09 02:36:07.853348 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.853195 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 02:36:07.853348 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.853237 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 02:36:07.853565 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.853543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 09 02:36:07.856415 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.856390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b"] Sep 09 02:36:07.945578 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.945550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d66707c-fafb-434a-b118-6d10cf72c865-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:07.945754 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.945590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:07.945754 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.945609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:07.945754 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.945681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:07.945754 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.945721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:07.945754 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:07.945737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds9hv\" (UniqueName: \"kubernetes.io/projected/3d66707c-fafb-434a-b118-6d10cf72c865-kube-api-access-ds9hv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047068 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047247 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047247 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047247 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds9hv\" (UniqueName: \"kubernetes.io/projected/3d66707c-fafb-434a-b118-6d10cf72c865-kube-api-access-ds9hv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047247 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d66707c-fafb-434a-b118-6d10cf72c865-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047247 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047530 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047530 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.047629 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.047597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.049503 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.049481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d66707c-fafb-434a-b118-6d10cf72c865-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.049786 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.049766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d66707c-fafb-434a-b118-6d10cf72c865-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.055320 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.055299 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds9hv\" (UniqueName: \"kubernetes.io/projected/3d66707c-fafb-434a-b118-6d10cf72c865-kube-api-access-ds9hv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pm79b\" (UID: \"3d66707c-fafb-434a-b118-6d10cf72c865\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.162431 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.162352 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:08.433846 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.433823 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b"] Sep 09 02:36:08.435836 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:36:08.435805 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d66707c_fafb_434a_b118_6d10cf72c865.slice/crio-8ae211c28ed9d6bd8770106da7225a9c4d19c1bd49d31b48191885ca790a2f69 WatchSource:0}: Error finding container 8ae211c28ed9d6bd8770106da7225a9c4d19c1bd49d31b48191885ca790a2f69: Status 404 returned error can't find the container with id 8ae211c28ed9d6bd8770106da7225a9c4d19c1bd49d31b48191885ca790a2f69 Sep 09 02:36:08.437116 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.437097 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 02:36:08.713474 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:08.713355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" event={"ID":"3d66707c-fafb-434a-b118-6d10cf72c865","Type":"ContainerStarted","Data":"8ae211c28ed9d6bd8770106da7225a9c4d19c1bd49d31b48191885ca790a2f69"} Sep 09 02:36:09.722705 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:09.722610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" event={"ID":"3d66707c-fafb-434a-b118-6d10cf72c865","Type":"ContainerStarted","Data":"d5d73928613730b43579591a2c1d9c6893d11c680995f0c67c6e4c636c7247c3"} Sep 09 02:36:09.738369 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:09.738316 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" podStartSLOduration=1.78971842 podStartE2EDuration="2.738301802s" totalImagesPullingTime="948.583382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:36:09.737869302 +0000 UTC m=+632.399405376" watchObservedRunningTime="2026-09-09 02:36:09.738301802 +0000 UTC m=+632.399837876" Sep 09 02:36:18.163025 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:18.162987 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:18.163455 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:18.163043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:18.176270 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:18.176243 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:36:18.774816 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:36:18.774785 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pm79b" Sep 09 02:37:06.215759 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.215627 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2"] Sep 09 02:37:06.218833 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.218817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.221098 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.221078 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 02:37:06.227627 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.227598 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2"] Sep 09 02:37:06.320627 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.320575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.320823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.320639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbw9g\" (UniqueName: \"kubernetes.io/projected/562fb26e-fb10-4172-a30c-9f8724079efa-kube-api-access-dbw9g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.320823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.320674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562fb26e-fb10-4172-a30c-9f8724079efa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.320823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.320705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.320823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.320768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.320823 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.320792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421419 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421624 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421624 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421624 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421624 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbw9g\" (UniqueName: \"kubernetes.io/projected/562fb26e-fb10-4172-a30c-9f8724079efa-kube-api-access-dbw9g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421624 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562fb26e-fb10-4172-a30c-9f8724079efa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421910 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.421910 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.422033 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.421966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.423856 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.423824 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562fb26e-fb10-4172-a30c-9f8724079efa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.424106 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.424089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562fb26e-fb10-4172-a30c-9f8724079efa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.429020 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.428995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbw9g\" (UniqueName: \"kubernetes.io/projected/562fb26e-fb10-4172-a30c-9f8724079efa-kube-api-access-dbw9g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2\" (UID: \"562fb26e-fb10-4172-a30c-9f8724079efa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.531806 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.531721 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:06.801183 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.801151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2"] Sep 09 02:37:06.802738 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:37:06.802709 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562fb26e_fb10_4172_a30c_9f8724079efa.slice/crio-800d3f947187a2c44cb57707795ce5b9f2e76177d4faa0d1441ca07cdd707bf8 WatchSource:0}: Error finding container 800d3f947187a2c44cb57707795ce5b9f2e76177d4faa0d1441ca07cdd707bf8: Status 404 returned error can't find the container with id 800d3f947187a2c44cb57707795ce5b9f2e76177d4faa0d1441ca07cdd707bf8 Sep 09 02:37:06.992305 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:06.992263 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" event={"ID":"562fb26e-fb10-4172-a30c-9f8724079efa","Type":"ContainerStarted","Data":"800d3f947187a2c44cb57707795ce5b9f2e76177d4faa0d1441ca07cdd707bf8"} Sep 09 02:37:07.998233 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:07.998201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" event={"ID":"562fb26e-fb10-4172-a30c-9f8724079efa","Type":"ContainerStarted","Data":"7f7d4b5331cf8a9f556436a2f2256f521cb655c0b140d833c840494e05a7aad2"} Sep 09 02:37:08.016352 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:08.016304 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" podStartSLOduration=1.8210404850000002 podStartE2EDuration="2.016287668s" totalImagesPullingTime="195.247183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:37:08.016094198 +0000 UTC m=+690.677630273" watchObservedRunningTime="2026-09-09 02:37:08.016287668 +0000 UTC m=+690.677823742" Sep 09 02:37:16.531904 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:16.531869 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:16.532469 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:16.531936 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:16.544074 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:16.544047 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:17.054057 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:17.054023 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2" Sep 09 02:37:28.431336 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.431270 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc"] Sep 09 02:37:28.435014 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.434981 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.437258 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.437233 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 09 02:37:28.446569 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.446542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc"] Sep 09 02:37:28.508328 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.508290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.508328 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.508331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.508541 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.508354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbj44\" (UniqueName: \"kubernetes.io/projected/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-kube-api-access-kbj44\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.508541 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.508381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.508541 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.508484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.508541 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.508518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.609696 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.609654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.609696 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.609697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.609898 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.609718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbj44\" (UniqueName: \"kubernetes.io/projected/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-kube-api-access-kbj44\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.609898 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.609865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.610011 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.609974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.610057 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.610014 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.610330 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.610305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.610424 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.610312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.610424 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.610374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.612445 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.612418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.612559 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.612485 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.616859 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.616836 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbj44\" (UniqueName: \"kubernetes.io/projected/99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4-kube-api-access-kbj44\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc\" (UID: \"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:28.745515 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:28.745421 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:29.014188 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:29.014161 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc"] Sep 09 02:37:29.015727 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:37:29.015692 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99c4d53c_c54a_47a9_bb87_c6dbefbbe0d4.slice/crio-5d915bbdfcdf2c936cb3ac27fa19cade664ad99342d1ef1965a1e4c3b4f16dd7 WatchSource:0}: Error finding container 5d915bbdfcdf2c936cb3ac27fa19cade664ad99342d1ef1965a1e4c3b4f16dd7: Status 404 returned error can't find the container with id 5d915bbdfcdf2c936cb3ac27fa19cade664ad99342d1ef1965a1e4c3b4f16dd7 Sep 09 02:37:29.102528 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:29.102495 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" event={"ID":"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4","Type":"ContainerStarted","Data":"5d915bbdfcdf2c936cb3ac27fa19cade664ad99342d1ef1965a1e4c3b4f16dd7"} Sep 09 02:37:30.109324 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:30.109234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" event={"ID":"99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4","Type":"ContainerStarted","Data":"e5a30b349e9e58826fea5a0c7a312991099be38abeefa35db5611b8d6d06051c"} Sep 09 02:37:30.126009 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:30.125942 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" podStartSLOduration=1.946759157 podStartE2EDuration="2.125909725s" totalImagesPullingTime="179.150568ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:37:30.123955764 +0000 UTC m=+712.785491837" watchObservedRunningTime="2026-09-09 02:37:30.125909725 +0000 UTC m=+712.787445799" Sep 09 02:37:38.745765 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:38.745720 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:38.745765 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:38.745773 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:38.758559 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:38.758530 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:37:39.162966 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:37:39.162934 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc" Sep 09 02:39:46.064709 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:46.064677 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kjzlg_2f437c8b-8951-4760-a146-c28a25307841/server/0.log" Sep 09 02:39:46.209974 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:46.209938 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gqbj2_9c04e1f4-0c2c-42d4-86c3-c3372a52a886/manager/0.log" Sep 09 02:39:46.340712 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:46.340686 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-95bmt_ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc/copy-manifests/0.log" Sep 09 02:39:46.347653 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:46.347627 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-95bmt_ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc/manager/0.log" Sep 09 02:39:49.186058 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:49.186029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r_4810b94b-b57f-4ee9-b170-4fe7b56f0d0c/istio-proxy/0.log" Sep 09 02:39:49.587222 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:49.587192 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-564645476c-ltxf6_60254c0d-086c-4dba-8c00-56ce53375e9b/kube-auth-proxy/0.log" Sep 09 02:39:49.840426 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:49.840328 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jhp8c_389b0e49-1058-4ae8-a64a-292d8ca77b93/payload-pre-processing/0.log" Sep 09 02:39:50.605095 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:50.605068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pm79b_3d66707c-fafb-434a-b118-6d10cf72c865/main/0.log" Sep 09 02:39:51.013717 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:51.013630 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwbbs2_562fb26e-fb10-4172-a30c-9f8724079efa/main/0.log" Sep 09 02:39:51.257642 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:51.257614 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-rzwmc_99c4d53c-c54a-47a9-bb87-c6dbefbbe0d4/main/0.log" Sep 09 02:39:57.515715 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.515677 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b28xp/must-gather-gzmrr"] Sep 09 02:39:57.519111 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.519096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:57.522018 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.521994 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b28xp\"/\"default-dockercfg-7crwr\"" Sep 09 02:39:57.522143 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.522104 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b28xp\"/\"openshift-service-ca.crt\"" Sep 09 02:39:57.522358 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.522340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b28xp\"/\"kube-root-ca.crt\"" Sep 09 02:39:57.533493 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.533472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b28xp/must-gather-gzmrr"] Sep 09 02:39:57.583612 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.583580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwnqx\" (UniqueName: \"kubernetes.io/projected/37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f-kube-api-access-kwnqx\") pod \"must-gather-gzmrr\" (UID: \"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f\") " pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:57.583758 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.583645 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f-must-gather-output\") pod \"must-gather-gzmrr\" (UID: \"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f\") " pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:57.684981 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.684918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f-must-gather-output\") pod \"must-gather-gzmrr\" (UID: \"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f\") " pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:57.685140 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.685042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwnqx\" (UniqueName: \"kubernetes.io/projected/37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f-kube-api-access-kwnqx\") pod \"must-gather-gzmrr\" (UID: \"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f\") " pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:57.685289 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.685272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f-must-gather-output\") pod \"must-gather-gzmrr\" (UID: \"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f\") " pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:57.692817 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.692795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwnqx\" (UniqueName: \"kubernetes.io/projected/37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f-kube-api-access-kwnqx\") pod \"must-gather-gzmrr\" (UID: \"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f\") " pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:57.827657 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:57.827632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b28xp/must-gather-gzmrr" Sep 09 02:39:58.096561 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:58.096486 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b28xp/must-gather-gzmrr"] Sep 09 02:39:58.099784 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:39:58.099757 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37dcd4f5_6d4d_4a07_95b8_806cd00c8a7f.slice/crio-3dec0ef6f185cf6a28e8b22e6b48b9ef24604f6ed64a3f8d7c2e014c1b255c0b WatchSource:0}: Error finding container 3dec0ef6f185cf6a28e8b22e6b48b9ef24604f6ed64a3f8d7c2e014c1b255c0b: Status 404 returned error can't find the container with id 3dec0ef6f185cf6a28e8b22e6b48b9ef24604f6ed64a3f8d7c2e014c1b255c0b Sep 09 02:39:58.829226 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:58.829186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b28xp/must-gather-gzmrr" event={"ID":"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f","Type":"ContainerStarted","Data":"3dec0ef6f185cf6a28e8b22e6b48b9ef24604f6ed64a3f8d7c2e014c1b255c0b"} Sep 09 02:39:59.837827 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:59.837784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b28xp/must-gather-gzmrr" event={"ID":"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f","Type":"ContainerStarted","Data":"46d9722bd5ac2629cd52195f263775f362365e27375fcb247d9cf0766ae85f1e"} Sep 09 02:39:59.838233 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:39:59.837839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b28xp/must-gather-gzmrr" event={"ID":"37dcd4f5-6d4d-4a07-95b8-806cd00c8a7f","Type":"ContainerStarted","Data":"98d3e5d5009d38d5f6d03a21d618e3ccd473b4777d2b5b18b6fa4fdb032ecd09"} Sep 09 02:40:00.555503 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:00.555467 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rvgmh_6e611bc0-3863-4aa4-a0fc-3271a812cf6e/global-pull-secret-syncer/0.log" Sep 09 02:40:00.665945 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:00.665891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z6swx_c7895003-734d-42df-9e10-721e3742ac12/konnectivity-agent/0.log" Sep 09 02:40:00.731884 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:00.731858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-68.ec2.internal_f92ac1b31a30df9df346e8510b9d388a/haproxy/0.log" Sep 09 02:40:06.942348 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:06.942310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fv242_fcb09e04-3cad-4bd0-840f-88565d10c7b8/node-exporter/0.log" Sep 09 02:40:06.984806 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:06.984756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fv242_fcb09e04-3cad-4bd0-840f-88565d10c7b8/kube-rbac-proxy/0.log" Sep 09 02:40:07.007094 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:07.007063 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fv242_fcb09e04-3cad-4bd0-840f-88565d10c7b8/init-textfile/0.log" Sep 09 02:40:09.496195 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:09.496161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-c6trr_b985b8b5-56ba-48dd-bb38-e8d3f0f2f4d6/networking-console-plugin/0.log" Sep 09 02:40:11.228458 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.228387 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b28xp/must-gather-gzmrr" podStartSLOduration=13.369396607 podStartE2EDuration="14.228365417s" totalImagesPullingTime="858.96881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:39:59.853388143 +0000 UTC m=+862.514924217" watchObservedRunningTime="2026-09-09 02:40:11.228365417 +0000 UTC m=+873.889901493" Sep 09 02:40:11.230528 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.230495 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr"] Sep 09 02:40:11.240704 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.240663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.246438 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.246403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr"] Sep 09 02:40:11.322353 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.322310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-proc\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.322540 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.322393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-sys\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.322540 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.322432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zckjk\" (UniqueName: \"kubernetes.io/projected/a5791292-97cb-4752-8489-d7ff071d231e-kube-api-access-zckjk\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.322540 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.322484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-lib-modules\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.322540 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.322507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-podres\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423253 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-lib-modules\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423436 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-podres\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423436 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-proc\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423436 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-sys\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423436 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zckjk\" (UniqueName: \"kubernetes.io/projected/a5791292-97cb-4752-8489-d7ff071d231e-kube-api-access-zckjk\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423436 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-lib-modules\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-podres\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423491 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-proc\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.423714 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.423528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5791292-97cb-4752-8489-d7ff071d231e-sys\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.432002 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.431976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zckjk\" (UniqueName: \"kubernetes.io/projected/a5791292-97cb-4752-8489-d7ff071d231e-kube-api-access-zckjk\") pod \"perf-node-gather-daemonset-fznsr\" (UID: \"a5791292-97cb-4752-8489-d7ff071d231e\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.564986 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.564884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:11.844615 ip-10-0-143-68 kubenswrapper[2581]: W0909 02:40:11.844546 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda5791292_97cb_4752_8489_d7ff071d231e.slice/crio-9a4c674cf8bbf1c2ff540dbf4bec24710ebbb88b7d0793a3950432276b0a0e1a WatchSource:0}: Error finding container 9a4c674cf8bbf1c2ff540dbf4bec24710ebbb88b7d0793a3950432276b0a0e1a: Status 404 returned error can't find the container with id 9a4c674cf8bbf1c2ff540dbf4bec24710ebbb88b7d0793a3950432276b0a0e1a Sep 09 02:40:11.854770 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.854742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr"] Sep 09 02:40:11.926726 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:11.926647 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" event={"ID":"a5791292-97cb-4752-8489-d7ff071d231e","Type":"ContainerStarted","Data":"9a4c674cf8bbf1c2ff540dbf4bec24710ebbb88b7d0793a3950432276b0a0e1a"} Sep 09 02:40:12.524912 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:12.524875 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xmb7_9af9df04-bb42-4217-b20d-d221562e2b90/dns/0.log" Sep 09 02:40:12.544898 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:12.544868 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xmb7_9af9df04-bb42-4217-b20d-d221562e2b90/kube-rbac-proxy/0.log" Sep 09 02:40:12.632862 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:12.632827 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mlxn4_686fcff3-3baf-4ef1-85af-45b2e7e7adb1/dns-node-resolver/0.log" Sep 09 02:40:12.936338 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:12.936300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" event={"ID":"a5791292-97cb-4752-8489-d7ff071d231e","Type":"ContainerStarted","Data":"f9f0ecc9d7056fc54771d39257b4c7a3a5056926e58a39538d275c5abd504bd9"} Sep 09 02:40:12.937366 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:12.937341 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:12.955051 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:12.954994 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" podStartSLOduration=1.954975275 podStartE2EDuration="1.954975275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:40:12.951710618 +0000 UTC m=+875.613246692" watchObservedRunningTime="2026-09-09 02:40:12.954975275 +0000 UTC m=+875.616511350" Sep 09 02:40:13.161328 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:13.161297 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bb9b4867d-wpcvr_772387c8-9523-4bb1-889e-7f1c26dd811e/registry/0.log" Sep 09 02:40:13.225444 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:13.225347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z5zrm_1ac3aafc-b20c-42f9-bb4b-d0f3bd7f0568/node-ca/0.log" Sep 09 02:40:14.122529 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:14.122501 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r_4810b94b-b57f-4ee9-b170-4fe7b56f0d0c/istio-proxy/0.log" Sep 09 02:40:14.227217 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:14.227192 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-564645476c-ltxf6_60254c0d-086c-4dba-8c00-56ce53375e9b/kube-auth-proxy/0.log" Sep 09 02:40:14.276130 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:14.276099 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jhp8c_389b0e49-1058-4ae8-a64a-292d8ca77b93/payload-pre-processing/0.log" Sep 09 02:40:14.988645 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:14.988619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v2rcg_08640fee-7e97-42de-a96d-8fcefea8ff01/serve-healthcheck-canary/0.log" Sep 09 02:40:15.584914 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:15.584886 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-whgkj_71d4e732-bca1-411a-8d67-9a20a788cef9/kube-rbac-proxy/0.log" Sep 09 02:40:15.604961 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:15.604918 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-whgkj_71d4e732-bca1-411a-8d67-9a20a788cef9/exporter/0.log" Sep 09 02:40:15.626057 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:15.626028 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-whgkj_71d4e732-bca1-411a-8d67-9a20a788cef9/extractor/0.log" Sep 09 02:40:17.783596 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:17.783557 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kjzlg_2f437c8b-8951-4760-a146-c28a25307841/server/0.log" Sep 09 02:40:17.852833 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:17.852804 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gqbj2_9c04e1f4-0c2c-42d4-86c3-c3372a52a886/manager/0.log" Sep 09 02:40:17.875779 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:17.875742 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-95bmt_ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc/manager/0.log" Sep 09 02:40:17.894108 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:17.894079 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-95bmt_ab9ccd48-4b7f-4f1e-a71e-51dfbb0cfbdc/copy-manifests/0.log" Sep 09 02:40:19.132677 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:19.132612 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cf499d5f9-5bdgl_9e56a2d7-3c75-40a6-b278-496bd30dfa6e/manager/0.log" Sep 09 02:40:19.961151 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:19.961122 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-fznsr" Sep 09 02:40:21.180888 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:21.180852 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r_4810b94b-b57f-4ee9-b170-4fe7b56f0d0c/istio-proxy/0.log" Sep 09 02:40:21.282226 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:21.282143 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-564645476c-ltxf6_60254c0d-086c-4dba-8c00-56ce53375e9b/kube-auth-proxy/0.log" Sep 09 02:40:21.321074 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:21.321045 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jhp8c_389b0e49-1058-4ae8-a64a-292d8ca77b93/payload-pre-processing/0.log" Sep 09 02:40:22.790862 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:22.790786 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cvgx2r_4810b94b-b57f-4ee9-b170-4fe7b56f0d0c/istio-proxy/0.log" Sep 09 02:40:22.874267 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:22.874169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-564645476c-ltxf6_60254c0d-086c-4dba-8c00-56ce53375e9b/kube-auth-proxy/0.log" Sep 09 02:40:22.911317 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:22.911282 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jhp8c_389b0e49-1058-4ae8-a64a-292d8ca77b93/payload-pre-processing/0.log" Sep 09 02:40:24.536501 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:24.536466 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-d5cfm_f42167a1-48ec-40c4-bed3-19d2ebe68786/migrator/0.log" Sep 09 02:40:24.556285 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:24.556262 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-d5cfm_f42167a1-48ec-40c4-bed3-19d2ebe68786/graceful-termination/0.log" Sep 09 02:40:26.085366 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.085331 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgngj_79ca6d29-ba35-4347-9237-4bcec72eafad/kube-multus-additional-cni-plugins/0.log" Sep 09 02:40:26.105092 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.105061 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgngj_79ca6d29-ba35-4347-9237-4bcec72eafad/egress-router-binary-copy/0.log" Sep 09 02:40:26.125778 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.125749 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgngj_79ca6d29-ba35-4347-9237-4bcec72eafad/cni-plugins/0.log" Sep 09 02:40:26.146370 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.146310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgngj_79ca6d29-ba35-4347-9237-4bcec72eafad/bond-cni-plugin/0.log" Sep 09 02:40:26.170841 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.170810 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgngj_79ca6d29-ba35-4347-9237-4bcec72eafad/routeoverride-cni/0.log" Sep 09 02:40:26.245066 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.245033 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgngj_79ca6d29-ba35-4347-9237-4bcec72eafad/whereabouts-cni-bincopy/0.log" Sep 09 02:40:26.286826 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.286802 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fgngj_79ca6d29-ba35-4347-9237-4bcec72eafad/whereabouts-cni/0.log" Sep 09 02:40:26.479975 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.479878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g9qkn_56d510b0-0b49-430b-a072-bc536507030c/kube-multus/0.log" Sep 09 02:40:26.539700 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.539654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6pdwv_78da3fd3-157b-4409-97a6-ba963de0e8f0/network-metrics-daemon/0.log" Sep 09 02:40:26.558597 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:26.558567 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6pdwv_78da3fd3-157b-4409-97a6-ba963de0e8f0/kube-rbac-proxy/0.log" Sep 09 02:40:27.787972 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.787939 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-controller/0.log" Sep 09 02:40:27.804761 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.804726 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/1.log" Sep 09 02:40:27.804969 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.804765 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovn-acl-logging/0.log" Sep 09 02:40:27.822367 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.822338 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/kube-rbac-proxy-node/0.log" Sep 09 02:40:27.841680 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.841623 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 02:40:27.861673 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.861648 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/northd/0.log" Sep 09 02:40:27.882434 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.882407 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/nbdb/0.log" Sep 09 02:40:27.902754 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.902728 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/sbdb/0.log" Sep 09 02:40:27.957097 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:27.957062 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gzpmf_fb996e5e-da82-4f88-b07a-76bb575b4fc0/ovnkube-controller/0.log" Sep 09 02:40:29.106687 ip-10-0-143-68 kubenswrapper[2581]: I0909 02:40:29.106654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fk762_e9262767-c90e-4484-925b-20f9e5752a21/network-check-target-container/0.log"