Sep 15 17:28:27.016580 ip-10-0-143-65 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 15 17:28:27.016594 ip-10-0-143-65 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 15 17:28:27.016605 ip-10-0-143-65 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 15 17:28:27.016814 ip-10-0-143-65 systemd[1]: Failed to start Kubernetes Kubelet. Sep 15 17:28:37.173217 ip-10-0-143-65 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 15 17:28:37.173235 ip-10-0-143-65 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f1fb94cd0c294555ad788fd44364de46 -- Sep 15 17:30:32.123466 ip-10-0-143-65 systemd[1]: Starting Kubernetes Kubelet... Sep 15 17:30:32.536246 ip-10-0-143-65 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 17:30:32.536246 ip-10-0-143-65 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 17:30:32.536246 ip-10-0-143-65 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 17:30:32.536246 ip-10-0-143-65 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 17:30:32.536246 ip-10-0-143-65 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 17:30:32.537859 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.537775 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 17:30:32.543085 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543059 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:30:32.543085 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543086 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543090 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543093 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543097 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543101 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543104 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543107 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543110 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543112 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543115 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543118 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543121 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543123 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543126 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543129 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543131 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543134 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543137 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543139 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543142 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:30:32.543155 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543144 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543147 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543150 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543152 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543155 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543158 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543161 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543164 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543166 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543169 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543172 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543175 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543177 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543180 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543183 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543185 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543188 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543191 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543195 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:30:32.543635 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543198 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543201 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543204 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543206 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543209 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543212 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543215 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543217 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543220 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543223 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543225 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543228 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543230 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543233 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543235 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543238 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543241 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543244 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543246 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543249 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:30:32.544105 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543251 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543254 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543257 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543259 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543262 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543264 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543267 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543269 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543272 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543275 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543278 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543281 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543283 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543286 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543288 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543298 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543302 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543304 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543307 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543310 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:30:32.544598 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543313 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543316 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543318 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543321 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543323 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543326 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543329 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543333 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543336 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543339 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543343 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543347 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543351 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543354 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543357 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543361 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543364 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543367 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.543370 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:30:32.545073 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544042 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544048 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544051 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544054 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544057 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544059 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544062 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544065 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544067 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544070 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544073 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544089 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544092 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544095 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544100 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544103 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544106 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544109 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544111 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:30:32.545580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544114 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544118 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544121 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544124 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544126 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544129 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544132 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544135 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544137 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544140 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544143 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544146 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544148 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544151 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544153 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544156 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544159 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544161 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544165 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544167 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:30:32.546044 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544170 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544173 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544175 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544177 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544180 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544182 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544185 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544187 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544190 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544192 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544195 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544197 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544200 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544205 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544208 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544210 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544213 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544215 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544218 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544220 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:30:32.546548 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544223 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544225 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544228 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544231 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544233 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544236 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544238 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544240 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544243 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544245 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544248 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544251 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544253 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544256 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544259 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544262 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544267 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544270 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544274 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:30:32.547029 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544277 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544280 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544283 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544286 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544288 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544291 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544296 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544299 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544301 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544304 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544307 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544309 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544311 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544314 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544316 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544319 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544321 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544324 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544327 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544329 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:30:32.547518 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544332 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544701 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544706 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544710 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544713 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544717 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544720 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544722 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544725 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544728 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544731 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544734 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544736 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544739 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544742 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544744 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544747 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544750 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544755 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:30:32.548007 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544758 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544760 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544763 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544766 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544768 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544771 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544773 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544776 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544778 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544781 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544784 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544787 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544789 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544792 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544794 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544797 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544799 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544803 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544806 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544809 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:30:32.548491 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544811 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544813 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544816 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544818 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544821 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544823 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544826 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544829 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544831 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544833 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544836 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544841 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544843 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544846 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544848 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544851 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544853 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544856 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544858 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544861 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:30:32.548974 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544863 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544866 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544868 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544871 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544873 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544876 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544879 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544882 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544884 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544887 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544889 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544892 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544894 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544896 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544899 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544902 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544905 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544907 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544910 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544912 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:30:32.549479 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544914 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544917 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544920 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544924 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544926 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544929 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544931 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544934 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544936 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544939 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544941 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544944 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544947 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544950 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544953 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544956 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544959 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544961 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544964 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544966 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:30:32.550047 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.544969 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545050 2562 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545094 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545100 2562 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545105 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545109 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545112 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545116 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545120 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545123 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545126 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545129 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545133 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545136 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545139 2562 flags.go:64] FLAG: --cgroup-root="" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545142 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545145 2562 flags.go:64] FLAG: --client-ca-file="" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545148 2562 flags.go:64] FLAG: --cloud-provider="external" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545151 2562 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545155 2562 flags.go:64] FLAG: --cluster-domain="" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545158 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545161 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545164 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545167 2562 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 17:30:32.550572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545171 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545174 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545176 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545180 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545182 2562 flags.go:64] FLAG: --contention-profiling="false" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545186 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545189 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545192 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545195 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545199 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545202 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545205 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545208 2562 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545211 2562 flags.go:64] FLAG: --enable-server="true" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545214 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545218 2562 flags.go:64] FLAG: --event-burst="100" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545221 2562 flags.go:64] FLAG: --event-qps="50" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545224 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545227 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545230 2562 flags.go:64] FLAG: --eviction-hard="" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545233 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545236 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545239 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545242 2562 flags.go:64] FLAG: --eviction-soft="" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545245 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 17:30:32.551176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545248 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545251 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545254 2562 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545257 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545260 2562 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545263 2562 flags.go:64] FLAG: --feature-gates="" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545266 2562 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545269 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545272 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545275 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545279 2562 flags.go:64] FLAG: --healthz-port="10248" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545282 2562 flags.go:64] FLAG: --help="false" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545285 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545288 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545291 2562 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545294 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545297 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545301 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545304 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545307 2562 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545309 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545312 2562 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545315 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545318 2562 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 17:30:32.551801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545321 2562 flags.go:64] FLAG: --kube-reserved="" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545324 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545326 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545329 2562 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545332 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545335 2562 flags.go:64] FLAG: --lock-file="" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545337 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545341 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545344 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545349 2562 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545351 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545355 2562 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545358 2562 flags.go:64] FLAG: --logging-format="text" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545361 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545364 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545367 2562 flags.go:64] FLAG: --manifest-url="" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545370 2562 flags.go:64] FLAG: --manifest-url-header="" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545374 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545377 2562 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545381 2562 flags.go:64] FLAG: --max-pods="110" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545384 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545387 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545390 2562 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545393 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545396 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 17:30:32.552745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545399 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545403 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545409 2562 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545412 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545415 2562 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545418 2562 flags.go:64] FLAG: --pod-cidr="" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545421 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545427 2562 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545430 2562 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545433 2562 flags.go:64] FLAG: --pods-per-core="0" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545436 2562 flags.go:64] FLAG: --port="10250" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545439 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545442 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b24b9d223808aca4" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545445 2562 flags.go:64] FLAG: --qos-reserved="" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545448 2562 flags.go:64] FLAG: --read-only-port="10255" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545451 2562 flags.go:64] FLAG: --register-node="true" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545454 2562 flags.go:64] FLAG: --register-with-taints="" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545458 2562 flags.go:64] FLAG: --registry-burst="10" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545460 2562 flags.go:64] FLAG: --registry-qps="5" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545463 2562 flags.go:64] FLAG: --reserved-cpus="" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545466 2562 flags.go:64] FLAG: --reserved-memory="" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545469 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545473 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545475 2562 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545478 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 17:30:32.553801 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545481 2562 flags.go:64] FLAG: --runonce="false" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545483 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545486 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545489 2562 flags.go:64] FLAG: --seccomp-default="false" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545492 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545495 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545498 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545501 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545504 2562 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545509 2562 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545512 2562 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545515 2562 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545517 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545520 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545523 2562 flags.go:64] FLAG: --system-cgroups="" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545526 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545531 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545534 2562 flags.go:64] FLAG: --tls-cert-file="" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545537 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545541 2562 flags.go:64] FLAG: --tls-min-version="" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545545 2562 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545547 2562 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545551 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545554 2562 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545556 2562 flags.go:64] FLAG: --v="2" Sep 15 17:30:32.554817 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545560 2562 flags.go:64] FLAG: --version="false" Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545564 2562 flags.go:64] FLAG: --vmodule="" Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545568 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.545571 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545685 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545689 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545692 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545695 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545697 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545700 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545702 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545705 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545707 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545710 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545713 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545717 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545723 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545726 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545729 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545732 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:30:32.555524 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545734 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545737 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545739 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545742 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545745 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545747 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545750 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545754 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545758 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545762 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545765 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545767 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545770 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545773 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545775 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545778 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545781 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545783 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545786 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:30:32.556024 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545788 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545791 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545793 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545796 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545799 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545801 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545804 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545807 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545809 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545813 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545816 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545818 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545821 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545823 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545826 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545830 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545833 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545837 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545840 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:30:32.556512 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545842 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545850 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545853 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545856 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545858 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545861 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545863 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545866 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545868 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545871 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545874 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545876 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545879 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545882 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545884 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545887 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545889 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545892 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545894 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545897 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:30:32.556980 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545899 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545902 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545906 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545909 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545911 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545914 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545917 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545919 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545922 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545925 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545927 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545930 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545932 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545936 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545938 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545941 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545944 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545946 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545949 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545952 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:30:32.557490 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545954 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545957 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545959 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545962 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.545965 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.546600 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.555882 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.556005 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.556019 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.556025 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556105 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556111 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556114 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556117 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556121 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:30:32.557976 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556124 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556127 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556130 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556133 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556136 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556139 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556142 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556144 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556147 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556150 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556152 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556155 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556157 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556160 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556163 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556165 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556168 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556171 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556175 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556179 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:30:32.558365 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556182 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556184 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556187 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556190 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556194 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556197 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556199 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556202 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556204 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556207 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556210 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556212 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556215 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556217 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556220 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556224 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556227 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556230 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556233 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:30:32.558892 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556236 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556239 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556242 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556244 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556248 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556250 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556253 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556256 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556258 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556261 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556263 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556266 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556268 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556271 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556273 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556276 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556279 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556282 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556284 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556287 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:30:32.559371 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556291 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556293 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556296 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556298 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556301 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556303 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556306 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556309 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556311 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556313 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556316 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556320 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556323 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556326 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556329 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556338 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556341 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556344 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556347 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:30:32.559859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556349 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556352 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556355 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556358 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556360 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556363 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556365 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556368 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556371 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556373 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556376 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556379 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556382 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556385 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556387 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:30:32.560337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556390 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.556395 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556528 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556533 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556536 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556539 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556542 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556545 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556548 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556551 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556554 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556557 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556560 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556563 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556567 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:30:32.560726 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556570 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556573 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556576 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556579 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556581 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556584 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556587 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556589 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556592 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556594 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556597 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556600 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556603 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556605 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556608 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556611 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556614 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556616 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556619 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556621 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:30:32.561122 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556624 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556627 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556629 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556632 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556634 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556637 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556640 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556642 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556644 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556647 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556650 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556652 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556655 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556658 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556661 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556663 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556666 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556669 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556672 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556677 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:30:32.561689 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556680 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556683 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556685 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556688 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556691 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556694 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556696 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556699 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556702 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556705 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556708 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556710 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556713 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556715 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556718 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556721 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556723 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556726 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556729 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556731 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:30:32.562218 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556734 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556736 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556739 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556742 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556744 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556749 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556752 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556755 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556758 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556761 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556764 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556766 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556769 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556771 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556774 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556778 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556785 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556789 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556791 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:30:32.562870 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556794 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556797 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556799 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556802 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556805 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556807 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:32.556810 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.556815 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.556921 2562 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.560506 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.561427 2562 server.go:1019] "Starting client certificate rotation" Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.561541 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 17:30:32.563577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.561593 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 17:30:32.564212 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.564198 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 17:30:32.565332 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.565314 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 17:30:32.574037 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.574020 2562 log.go:25] "Validated CRI v1 runtime API" Sep 15 17:30:32.578709 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.578697 2562 log.go:25] "Validated CRI v1 image API" Sep 15 17:30:32.580961 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.580947 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 17:30:32.584306 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.584290 2562 fs.go:135] Filesystem UUIDs: map[2047d152-4337-4b82-bad2-7a6e7e60b0d4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dab4f4e9-771d-41dc-9b31-62dd14c90839:/dev/nvme0n1p4] Sep 15 17:30:32.584355 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.584306 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 17:30:32.587673 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.587652 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 17:30:32.590497 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.590395 2562 manager.go:216] Machine: {Timestamp:2026-09-15 17:30:32.589010466 +0000 UTC m=+0.347122328 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096439 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a20d3efc6eaefa9b33553af74683f SystemUUID:ec2a20d3-efc6-eaef-a9b3-3553af74683f BootID:f1fb94cd-0c29-4555-ad78-8fd44364de46 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:00:b8:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:00:b8:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:31:0d:a3:ae:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 17:30:32.590497 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.590496 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 17:30:32.590604 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.590594 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 17:30:32.594825 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.594793 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 17:30:32.594952 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.594829 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-65.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 17:30:32.595664 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.595653 2562 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 17:30:32.595697 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.595667 2562 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 17:30:32.595697 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.595674 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 17:30:32.596386 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.596377 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 17:30:32.597148 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.597138 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 17:30:32.599820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.599809 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 15 17:30:32.599923 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.599915 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 17:30:32.599952 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.599943 2562 kubelet.go:486] "Attempting to sync node with API server" Sep 15 17:30:32.599985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.599952 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 17:30:32.599985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.599965 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 17:30:32.599985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.599974 2562 kubelet.go:398] "Adding apiserver pod source" Sep 15 17:30:32.599985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.599983 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 17:30:32.600317 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.600300 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 17:30:32.600394 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.600328 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 17:30:32.602396 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.602379 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 17:30:32.603994 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.603978 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 17:30:32.604044 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.604012 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 17:30:32.606086 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606061 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 17:30:32.606139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606096 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 17:30:32.606139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606104 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 17:30:32.606139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606109 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 17:30:32.606139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606118 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 17:30:32.606139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606123 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 17:30:32.606139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606137 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 17:30:32.606139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606142 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 17:30:32.606322 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606150 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 17:30:32.606322 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606156 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 17:30:32.606322 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606164 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 17:30:32.606322 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.606169 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 17:30:32.607491 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.607474 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nlzz" Sep 15 17:30:32.607613 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.607600 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 17:30:32.607644 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.607616 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 17:30:32.608693 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.608672 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 17:30:32.608860 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.608838 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 17:30:32.611375 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.611363 2562 server.go:1268] "Started kubelet" Sep 15 17:30:32.611468 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.611424 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 17:30:32.611525 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.611454 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 17:30:32.611570 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.611528 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 17:30:32.612199 ip-10-0-143-65 systemd[1]: Started Kubernetes Kubelet. Sep 15 17:30:32.614527 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.614509 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nlzz" Sep 15 17:30:32.614708 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.614685 2562 server.go:310] "Adding debug handlers to kubelet server" Sep 15 17:30:32.615987 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.615973 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 17:30:32.616945 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.616790 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 17:30:32.619068 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.619050 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-65.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 17:30:32.619959 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.619097 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-65.ec2.internal.18d58ecbbab16ab6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-65.ec2.internal,UID:ip-10-0-143-65.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-65.ec2.internal,},FirstTimestamp:2026-09-15 17:30:32.611334838 +0000 UTC m=+0.369446703,LastTimestamp:2026-09-15 17:30:32.611334838 +0000 UTC m=+0.369446703,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-65.ec2.internal,}" Sep 15 17:30:32.621699 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.621681 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 17:30:32.621803 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.621742 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 17:30:32.622066 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.622050 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:32.622414 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.622397 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 17:30:32.622517 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.622440 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 17:30:32.622517 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.622397 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 17:30:32.622643 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.622525 2562 reconstruct.go:97] "Volume reconstruction finished" Sep 15 17:30:32.622643 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.622532 2562 reconciler.go:29] "Reconciler: start to sync state" Sep 15 17:30:32.623065 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623052 2562 factory.go:55] Registering systemd factory Sep 15 17:30:32.623065 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623066 2562 factory.go:223] Registration of the systemd container factory successfully Sep 15 17:30:32.623336 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623325 2562 factory.go:153] Registering CRI-O factory Sep 15 17:30:32.623336 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623338 2562 factory.go:223] Registration of the crio container factory successfully Sep 15 17:30:32.623407 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623378 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 17:30:32.623407 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623391 2562 factory.go:103] Registering Raw factory Sep 15 17:30:32.623407 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623401 2562 manager.go:1196] Started watching for new ooms in manager Sep 15 17:30:32.623853 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.623841 2562 manager.go:349] Starting recovery of all containers Sep 15 17:30:32.626216 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.626200 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:30:32.633072 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.633046 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-65.ec2.internal\" not found" node="ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.638219 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.638203 2562 manager.go:354] Recovery completed Sep 15 17:30:32.642619 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.642607 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:30:32.644199 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.644185 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:30:32.644269 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.644210 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:30:32.644269 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.644221 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:30:32.644731 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.644718 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 17:30:32.644731 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.644729 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 17:30:32.644841 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.644745 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 15 17:30:32.644841 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.644772 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:30:32.645495 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.645479 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:30:32.645553 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.645507 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:30:32.645553 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.645519 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:30:32.645949 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.645932 2562 policy_none.go:49] "None policy: Start" Sep 15 17:30:32.646026 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.645953 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 17:30:32.646026 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.645966 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 17:30:32.647043 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.647032 2562 policy_none.go:47] "Start" Sep 15 17:30:32.690640 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.690624 2562 manager.go:337] "Starting Device Plugin manager" Sep 15 17:30:32.690773 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.690670 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 17:30:32.690773 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.690684 2562 server.go:87] "Starting device plugin registration server" Sep 15 17:30:32.690958 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.690945 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 17:30:32.691020 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.690959 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 17:30:32.691096 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.691068 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 17:30:32.691195 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.691183 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 17:30:32.691195 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.691195 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 17:30:32.691650 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.691631 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 17:30:32.691759 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.691681 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:32.734883 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.734859 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 17:30:32.736099 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.736068 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 17:30:32.736172 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.736141 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 17:30:32.736172 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.736169 2562 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 17:30:32.736283 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.736205 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 17:30:32.738750 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.738727 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:30:32.791915 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.791808 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:30:32.792814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.792787 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:30:32.792919 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.792823 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:30:32.792919 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.792835 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:30:32.792919 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.792860 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.798905 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.798887 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.799012 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.798914 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-65.ec2.internal\": node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:32.811703 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.811683 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:32.837198 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.837178 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal"] Sep 15 17:30:32.837259 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.837249 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:30:32.838634 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.838619 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:30:32.838701 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.838646 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:30:32.838701 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.838656 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:30:32.840884 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.840872 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:30:32.841003 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.840990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.841045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.841015 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:30:32.841598 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.841577 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:30:32.841685 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.841611 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:30:32.841685 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.841621 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:30:32.841685 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.841665 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:30:32.841685 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.841684 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:30:32.841802 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.841706 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:30:32.843745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.843728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.843897 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.843753 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:30:32.844420 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.844358 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:30:32.844420 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.844380 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:30:32.844420 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.844403 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:30:32.871691 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.871673 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-65.ec2.internal\" not found" node="ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.876159 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.876146 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-65.ec2.internal\" not found" node="ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.912545 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:32.912522 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:32.924725 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.924708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/453b634f922d3bc29f446925d3a931fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"453b634f922d3bc29f446925d3a931fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.924794 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.924732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f5d4104f78662c719231b0e8fdcd77c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-65.ec2.internal\" (UID: \"4f5d4104f78662c719231b0e8fdcd77c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" Sep 15 17:30:32.924794 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:32.924748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/453b634f922d3bc29f446925d3a931fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"453b634f922d3bc29f446925d3a931fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.013366 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.013336 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:33.025757 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.025722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/453b634f922d3bc29f446925d3a931fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"453b634f922d3bc29f446925d3a931fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.025835 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.025766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/453b634f922d3bc29f446925d3a931fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"453b634f922d3bc29f446925d3a931fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.025835 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.025790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f5d4104f78662c719231b0e8fdcd77c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-65.ec2.internal\" (UID: \"4f5d4104f78662c719231b0e8fdcd77c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.025926 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.025820 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/453b634f922d3bc29f446925d3a931fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"453b634f922d3bc29f446925d3a931fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.025926 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.025839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f5d4104f78662c719231b0e8fdcd77c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-65.ec2.internal\" (UID: \"4f5d4104f78662c719231b0e8fdcd77c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.025926 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.025852 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/453b634f922d3bc29f446925d3a931fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"453b634f922d3bc29f446925d3a931fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.114255 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.114175 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:33.173738 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.173706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.178637 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.178506 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.214766 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.214733 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:33.315200 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.315163 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:33.415566 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.415505 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:33.515850 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.515814 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" Sep 15 17:30:33.552255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.552233 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:30:33.561002 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.560981 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 17:30:33.561120 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.561103 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 17:30:33.561179 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.561115 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 17:30:33.561179 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.561131 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 17:30:33.600192 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.600164 2562 apiserver.go:52] "Watching apiserver" Sep 15 17:30:33.620797 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.620768 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 17:25:32 +0000 UTC" deadline="2028-05-10 07:30:21.554768581 +0000 UTC" Sep 15 17:30:33.620797 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.620791 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14461h59m47.933980024s" Sep 15 17:30:33.621841 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.621828 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 17:30:33.622007 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.621992 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.623217 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.623200 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 17:30:33.624839 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.624811 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-b9wkp","openshift-network-operator/iptables-alerter-mv6cw","openshift-dns/node-resolver-6ftln","openshift-multus/multus-additional-cni-plugins-gz89h","openshift-multus/multus-jhrht","openshift-network-diagnostics/network-check-target-tkbgj","openshift-ovn-kubernetes/ovnkube-node-hnqzm","kube-system/global-pull-secret-syncer-h9bvw","kube-system/konnectivity-agent-lxf8d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5","openshift-cluster-node-tuning-operator/tuned-njxct","openshift-image-registry/node-ca-hkrrv"] Sep 15 17:30:33.627409 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.627392 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:33.627494 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.627477 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:33.629441 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.629429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.631475 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.631454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.631625 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.631545 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 17:30:33.631625 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.631558 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:30:33.631797 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.631783 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6wn77\"" Sep 15 17:30:33.631900 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.631885 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 17:30:33.633568 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.633553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.633857 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.633844 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 17:30:33.634003 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.633989 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vvkxd\"" Sep 15 17:30:33.634093 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.634003 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" Sep 15 17:30:33.634203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.634189 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 17:30:33.634263 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.634219 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 17:30:33.635728 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.635714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.635827 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.635814 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 17:30:33.636070 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.636055 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 17:30:33.636070 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.636066 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 17:30:33.636196 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.636116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2hgk8\"" Sep 15 17:30:33.636196 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.636141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 17:30:33.636314 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.636303 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 17:30:33.637026 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.637012 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 17:30:33.637840 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.637826 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c9s98\"" Sep 15 17:30:33.637886 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.637872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:33.637946 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.637931 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:33.638097 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.638065 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 17:30:33.640037 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.640022 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.642141 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.642126 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.642226 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.642214 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 17:30:33.642286 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.642218 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 17:30:33.642286 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.642237 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:33.642521 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.642510 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 17:30:33.642556 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.642538 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 17:30:33.643403 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.643386 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 17:30:33.643490 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.643408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-twxxh\"" Sep 15 17:30:33.643490 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.643394 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 17:30:33.643490 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.643394 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 17:30:33.644306 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.644287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:33.646441 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.646406 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 17:30:33.646441 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.646418 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 17:30:33.646583 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.646569 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zfh65\"" Sep 15 17:30:33.646637 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.646626 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.648743 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.648724 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 17:30:33.648860 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.648745 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 17:30:33.648860 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.648823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.648981 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.648907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ggp67\"" Sep 15 17:30:33.651736 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.651716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 17:30:33.652131 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.651765 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 17:30:33.652131 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.651829 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:30:33.653444 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.652773 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-99kc4\"" Sep 15 17:30:33.655530 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.655515 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal"] Sep 15 17:30:33.655579 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.655539 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal"] Sep 15 17:30:33.655613 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.655593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.656643 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.656630 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-48pfk" Sep 15 17:30:33.657680 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.657666 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 17:30:33.657872 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.657857 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 17:30:33.657912 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.657863 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 17:30:33.657944 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.657923 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mcgvr\"" Sep 15 17:30:33.661999 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.661986 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-48pfk" Sep 15 17:30:33.724064 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.724041 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 17:30:33.728319 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-systemd\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.728422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-sys\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.728422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-daemon-config\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.728422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-ovn\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.728422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8mjs\" (UniqueName: \"kubernetes.io/projected/39de77f7-738d-4a4e-8bef-75e200987696-kube-api-access-d8mjs\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-run\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-hosts-file\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-var-lib-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-kubelet-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsvw5\" (UniqueName: \"kubernetes.io/projected/8f1f02c5-0706-4816-87f7-105c522ad7b8-kube-api-access-xsvw5\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6640a792-9ce0-430e-95e4-4fb05d8fc231-konnectivity-ca\") pod \"konnectivity-agent-lxf8d\" (UID: \"6640a792-9ce0-430e-95e4-4fb05d8fc231\") " pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:33.728620 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-netns\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-hostroot\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-systemd\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqcqh\" (UniqueName: \"kubernetes.io/projected/4c48329a-81ec-4235-8baf-a50cd9d9babb-kube-api-access-tqcqh\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cnibin\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-env-overrides\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovnkube-script-lib\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d408293d-1144-45a4-a887-c18aae4d190b-kubelet-config\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-device-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysctl-conf\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.728913 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-var-lib-kubelet\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6gbc\" (UniqueName: \"kubernetes.io/projected/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-kube-api-access-b6gbc\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-cni-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.728982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-multus-certs\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-system-cni-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f1f02c5-0706-4816-87f7-105c522ad7b8-cni-binary-copy\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-slash\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1874e1af-e942-44bf-92ec-5f5d42c2bb97-tmp\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be3e6f01-bb44-4ffc-8bd3-03c965953454-serviceca\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpg86\" (UniqueName: \"kubernetes.io/projected/be3e6f01-bb44-4ffc-8bd3-03c965953454-kube-api-access-fpg86\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-cni-multus\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-conf-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-cni-netd\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysconfig\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysctl-d\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.729390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjgb\" (UniqueName: \"kubernetes.io/projected/d94489f1-50e8-4935-a293-149b65aa4c7f-kube-api-access-djjgb\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-socket-dir-parent\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-systemd-units\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-node-log\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovn-node-metrics-cert\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-kubernetes\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-tmp-dir\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d408293d-1144-45a4-a887-c18aae4d190b-dbus\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be3e6f01-bb44-4ffc-8bd3-03c965953454-host\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-cni-bin\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-kubelet\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-lib-modules\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0788f07-77c5-4d7d-906a-5682493a56f3-iptables-alerter-script\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.729985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq947\" (UniqueName: \"kubernetes.io/projected/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-kube-api-access-nq947\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-k8s-cni-cncf-io\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-socket-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-registration-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0788f07-77c5-4d7d-906a-5682493a56f3-host-slash\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-cnibin\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-etc-kubernetes\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.729992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-run-netns\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-sys-fs\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-modprobe-d\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkkhh\" (UniqueName: \"kubernetes.io/projected/a0788f07-77c5-4d7d-906a-5682493a56f3-kube-api-access-hkkhh\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-system-cni-dir\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-etc-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.730574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-log-socket\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-etc-selinux\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-host\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-kubelet\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-cni-bin\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovnkube-config\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6640a792-9ce0-430e-95e4-4fb05d8fc231-agent-certs\") pod \"konnectivity-agent-lxf8d\" (UID: \"6640a792-9ce0-430e-95e4-4fb05d8fc231\") " pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-tuned\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.731045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.730384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgc5m\" (UniqueName: \"kubernetes.io/projected/1874e1af-e942-44bf-92ec-5f5d42c2bb97-kube-api-access-fgc5m\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.830596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-tuned\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.830596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgc5m\" (UniqueName: \"kubernetes.io/projected/1874e1af-e942-44bf-92ec-5f5d42c2bb97-kube-api-access-fgc5m\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-systemd\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-sys\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-daemon-config\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830715 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-systemd\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-sys\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-ovn\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8mjs\" (UniqueName: \"kubernetes.io/projected/39de77f7-738d-4a4e-8bef-75e200987696-kube-api-access-d8mjs\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.830816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-run\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830822 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-ovn\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-hosts-file\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-var-lib-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830867 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-hosts-file\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-kubelet-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830900 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-run\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830909 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-var-lib-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsvw5\" (UniqueName: \"kubernetes.io/projected/8f1f02c5-0706-4816-87f7-105c522ad7b8-kube-api-access-xsvw5\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830943 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-kubelet-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.830978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6640a792-9ce0-430e-95e4-4fb05d8fc231-konnectivity-ca\") pod \"konnectivity-agent-lxf8d\" (UID: \"6640a792-9ce0-430e-95e4-4fb05d8fc231\") " pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.831013 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-netns\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-hostroot\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-systemd\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.831101 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:30:34.331068297 +0000 UTC m=+2.089180161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:33.831203 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831105 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-netns\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqcqh\" (UniqueName: \"kubernetes.io/projected/4c48329a-81ec-4235-8baf-a50cd9d9babb-kube-api-access-tqcqh\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831131 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-systemd\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cnibin\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-env-overrides\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-daemon-config\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cnibin\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovnkube-script-lib\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831153 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-hostroot\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d408293d-1144-45a4-a887-c18aae4d190b-kubelet-config\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-device-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831284 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d408293d-1144-45a4-a887-c18aae4d190b-kubelet-config\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysctl-conf\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-var-lib-kubelet\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-device-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gbc\" (UniqueName: \"kubernetes.io/projected/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-kube-api-access-b6gbc\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.832012 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-cni-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-multus-certs\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-system-cni-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f1f02c5-0706-4816-87f7-105c522ad7b8-cni-binary-copy\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysctl-conf\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6640a792-9ce0-430e-95e4-4fb05d8fc231-konnectivity-ca\") pod \"konnectivity-agent-lxf8d\" (UID: \"6640a792-9ce0-430e-95e4-4fb05d8fc231\") " pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-slash\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1874e1af-e942-44bf-92ec-5f5d42c2bb97-tmp\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be3e6f01-bb44-4ffc-8bd3-03c965953454-serviceca\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831593 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-multus-certs\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpg86\" (UniqueName: \"kubernetes.io/projected/be3e6f01-bb44-4ffc-8bd3-03c965953454-kube-api-access-fpg86\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-env-overrides\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-cni-multus\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831656 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-slash\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831656 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-cni-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-conf-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831686 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-system-cni-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.832814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-cni-netd\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysconfig\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysctl-d\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djjgb\" (UniqueName: \"kubernetes.io/projected/d94489f1-50e8-4935-a293-149b65aa4c7f-kube-api-access-djjgb\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-socket-dir-parent\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-systemd-units\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-node-log\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831855 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovnkube-script-lib\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovn-node-metrics-cert\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831876 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-node-log\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.831933 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysconfig\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832021 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832106 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-sysctl-d\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832106 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-socket-dir-parent\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832108 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-systemd-units\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832124 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f1f02c5-0706-4816-87f7-105c522ad7b8-cni-binary-copy\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.833627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-cni-multus\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832176 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-multus-conf-dir\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-cni-netd\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-kubernetes\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-tmp-dir\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d408293d-1144-45a4-a887-c18aae4d190b-dbus\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be3e6f01-bb44-4ffc-8bd3-03c965953454-host\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-cni-bin\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-kubelet\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-lib-modules\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0788f07-77c5-4d7d-906a-5682493a56f3-iptables-alerter-script\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq947\" (UniqueName: \"kubernetes.io/projected/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-kube-api-access-nq947\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-k8s-cni-cncf-io\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be3e6f01-bb44-4ffc-8bd3-03c965953454-serviceca\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.834422 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832534 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-socket-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-registration-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832744 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.832756 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0788f07-77c5-4d7d-906a-5682493a56f3-host-slash\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-cni-bin\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.832805 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret podName:d408293d-1144-45a4-a887-c18aae4d190b nodeName:}" failed. No retries permitted until 2026-09-15 17:30:34.332790862 +0000 UTC m=+2.090902726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret") pod "global-pull-secret-syncer-h9bvw" (UID: "d408293d-1144-45a4-a887-c18aae4d190b") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832702 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d408293d-1144-45a4-a887-c18aae4d190b-dbus\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-socket-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-cnibin\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-etc-kubernetes\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832870 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-cnibin\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832792 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be3e6f01-bb44-4ffc-8bd3-03c965953454-host\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832904 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-run-netns\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832872 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-run-netns\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.835168 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832610 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832936 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-registration-dir\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-sys-fs\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832958 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-etc-kubernetes\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832587 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-kubernetes\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832976 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-sys-fs\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-modprobe-d\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832585 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-var-lib-kubelet\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832241 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-var-lib-kubelet\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0788f07-77c5-4d7d-906a-5682493a56f3-host-slash\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkkhh\" (UniqueName: \"kubernetes.io/projected/a0788f07-77c5-4d7d-906a-5682493a56f3-kube-api-access-hkkhh\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833029 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f1f02c5-0706-4816-87f7-105c522ad7b8-host-run-k8s-cni-cncf-io\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-system-cni-dir\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833070 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-tmp-dir\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-run-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.832661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-lib-modules\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833103 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-modprobe-d\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.835622 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833107 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-system-cni-dir\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833162 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-etc-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833171 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0788f07-77c5-4d7d-906a-5682493a56f3-iptables-alerter-script\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-log-socket\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-etc-openvswitch\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833254 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-log-socket\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-etc-selinux\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833292 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-host\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-kubelet\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833344 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1874e1af-e942-44bf-92ec-5f5d42c2bb97-host\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-cni-bin\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833361 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39de77f7-738d-4a4e-8bef-75e200987696-etc-selinux\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovnkube-config\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836112 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833377 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-kubelet\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836586 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6640a792-9ce0-430e-95e4-4fb05d8fc231-agent-certs\") pod \"konnectivity-agent-lxf8d\" (UID: \"6640a792-9ce0-430e-95e4-4fb05d8fc231\") " pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:33.836586 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833396 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c48329a-81ec-4235-8baf-a50cd9d9babb-host-cni-bin\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836586 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.833808 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovnkube-config\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836586 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.834685 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1874e1af-e942-44bf-92ec-5f5d42c2bb97-etc-tuned\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.836586 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.835104 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c48329a-81ec-4235-8baf-a50cd9d9babb-ovn-node-metrics-cert\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.836586 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.835118 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1874e1af-e942-44bf-92ec-5f5d42c2bb97-tmp\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.836586 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.835355 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6640a792-9ce0-430e-95e4-4fb05d8fc231-agent-certs\") pod \"konnectivity-agent-lxf8d\" (UID: \"6640a792-9ce0-430e-95e4-4fb05d8fc231\") " pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:33.843438 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.843416 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgc5m\" (UniqueName: \"kubernetes.io/projected/1874e1af-e942-44bf-92ec-5f5d42c2bb97-kube-api-access-fgc5m\") pod \"tuned-njxct\" (UID: \"1874e1af-e942-44bf-92ec-5f5d42c2bb97\") " pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:33.843676 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.843660 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqcqh\" (UniqueName: \"kubernetes.io/projected/4c48329a-81ec-4235-8baf-a50cd9d9babb-kube-api-access-tqcqh\") pod \"ovnkube-node-hnqzm\" (UID: \"4c48329a-81ec-4235-8baf-a50cd9d9babb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:33.843840 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.843822 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8mjs\" (UniqueName: \"kubernetes.io/projected/39de77f7-738d-4a4e-8bef-75e200987696-kube-api-access-d8mjs\") pod \"aws-ebs-csi-driver-node-495j5\" (UID: \"39de77f7-738d-4a4e-8bef-75e200987696\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:33.844452 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.844430 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsvw5\" (UniqueName: \"kubernetes.io/projected/8f1f02c5-0706-4816-87f7-105c522ad7b8-kube-api-access-xsvw5\") pod \"multus-jhrht\" (UID: \"8f1f02c5-0706-4816-87f7-105c522ad7b8\") " pod="openshift-multus/multus-jhrht" Sep 15 17:30:33.844842 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.844821 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:30:33.844934 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.844845 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:30:33.844934 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.844858 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rfm2d for pod openshift-network-diagnostics/network-check-target-tkbgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:33.844934 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:33.844913 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d podName:04f55807-184b-4c00-9eb2-edc5c802d273 nodeName:}" failed. No retries permitted until 2026-09-15 17:30:34.344898802 +0000 UTC m=+2.103010667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rfm2d" (UniqueName: "kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d") pod "network-check-target-tkbgj" (UID: "04f55807-184b-4c00-9eb2-edc5c802d273") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:33.846363 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.846342 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6gbc\" (UniqueName: \"kubernetes.io/projected/0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9-kube-api-access-b6gbc\") pod \"node-resolver-6ftln\" (UID: \"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9\") " pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:33.846724 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.846706 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpg86\" (UniqueName: \"kubernetes.io/projected/be3e6f01-bb44-4ffc-8bd3-03c965953454-kube-api-access-fpg86\") pod \"node-ca-hkrrv\" (UID: \"be3e6f01-bb44-4ffc-8bd3-03c965953454\") " pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:33.846795 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.846741 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkkhh\" (UniqueName: \"kubernetes.io/projected/a0788f07-77c5-4d7d-906a-5682493a56f3-kube-api-access-hkkhh\") pod \"iptables-alerter-mv6cw\" (UID: \"a0788f07-77c5-4d7d-906a-5682493a56f3\") " pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.846903 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.846888 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq947\" (UniqueName: \"kubernetes.io/projected/53bfa278-4cbe-4ba2-89c5-8d45bb954e77-kube-api-access-nq947\") pod \"multus-additional-cni-plugins-gz89h\" (UID: \"53bfa278-4cbe-4ba2-89c5-8d45bb954e77\") " pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:33.846903 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.846893 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjgb\" (UniqueName: \"kubernetes.io/projected/d94489f1-50e8-4935-a293-149b65aa4c7f-kube-api-access-djjgb\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:33.957615 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.957545 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:30:33.966368 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.966347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mv6cw" Sep 15 17:30:33.989220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:33.989188 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6ftln" Sep 15 17:30:34.011380 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.011358 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gz89h" Sep 15 17:30:34.026033 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.026008 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jhrht" Sep 15 17:30:34.031876 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.031856 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:30:34.048314 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.048282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:34.061715 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.061695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" Sep 15 17:30:34.066398 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.066376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-njxct" Sep 15 17:30:34.070067 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.070051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hkrrv" Sep 15 17:30:34.131060 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.131025 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5d4104f78662c719231b0e8fdcd77c.slice/crio-5f887ff6f2ec5745fabeb3eba5da1c5661126ec3342dd796a6f9ae2ba784cf1b WatchSource:0}: Error finding container 5f887ff6f2ec5745fabeb3eba5da1c5661126ec3342dd796a6f9ae2ba784cf1b: Status 404 returned error can't find the container with id 5f887ff6f2ec5745fabeb3eba5da1c5661126ec3342dd796a6f9ae2ba784cf1b Sep 15 17:30:34.134680 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.134663 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 17:30:34.335570 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.335502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:34.335570 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.335550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:34.335727 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.335641 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:34.335727 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.335646 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:34.335727 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.335697 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret podName:d408293d-1144-45a4-a887-c18aae4d190b nodeName:}" failed. No retries permitted until 2026-09-15 17:30:35.335683542 +0000 UTC m=+3.093795408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret") pod "global-pull-secret-syncer-h9bvw" (UID: "d408293d-1144-45a4-a887-c18aae4d190b") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:34.335727 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.335710 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:30:35.335704572 +0000 UTC m=+3.093816421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:34.356994 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.356970 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bfa278_4cbe_4ba2_89c5_8d45bb954e77.slice/crio-73e301e4f90840d8e069a441d5b2a7d2772a7fa26ea2baa6b09d8f283a8ec981 WatchSource:0}: Error finding container 73e301e4f90840d8e069a441d5b2a7d2772a7fa26ea2baa6b09d8f283a8ec981: Status 404 returned error can't find the container with id 73e301e4f90840d8e069a441d5b2a7d2772a7fa26ea2baa6b09d8f283a8ec981 Sep 15 17:30:34.377087 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.377058 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:30:34.381053 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.381030 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4fa2b3_0406_4f60_9a2e_79c3c2b882a9.slice/crio-e3b52395361e96eb55ddfccc9fdc579a177df82fad65800ff9d6751e51092a20 WatchSource:0}: Error finding container e3b52395361e96eb55ddfccc9fdc579a177df82fad65800ff9d6751e51092a20: Status 404 returned error can't find the container with id e3b52395361e96eb55ddfccc9fdc579a177df82fad65800ff9d6751e51092a20 Sep 15 17:30:34.381873 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.381850 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39de77f7_738d_4a4e_8bef_75e200987696.slice/crio-c4031653b4c6f37db65b105868ff49336b5b35781a0ea29d70a5e989136c3e4a WatchSource:0}: Error finding container c4031653b4c6f37db65b105868ff49336b5b35781a0ea29d70a5e989136c3e4a: Status 404 returned error can't find the container with id c4031653b4c6f37db65b105868ff49336b5b35781a0ea29d70a5e989136c3e4a Sep 15 17:30:34.393859 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.393841 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c48329a_81ec_4235_8baf_a50cd9d9babb.slice/crio-cef4bc7f18528adefa77dda9cbeaacf7d8560b7dda72679eb0bfbbcf28411d78 WatchSource:0}: Error finding container cef4bc7f18528adefa77dda9cbeaacf7d8560b7dda72679eb0bfbbcf28411d78: Status 404 returned error can't find the container with id cef4bc7f18528adefa77dda9cbeaacf7d8560b7dda72679eb0bfbbcf28411d78 Sep 15 17:30:34.436406 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.436382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:34.436512 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.436498 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:30:34.436512 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.436512 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:30:34.436590 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.436520 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rfm2d for pod openshift-network-diagnostics/network-check-target-tkbgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:34.436590 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.436560 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d podName:04f55807-184b-4c00-9eb2-edc5c802d273 nodeName:}" failed. No retries permitted until 2026-09-15 17:30:35.436547843 +0000 UTC m=+3.194659692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfm2d" (UniqueName: "kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d") pod "network-check-target-tkbgj" (UID: "04f55807-184b-4c00-9eb2-edc5c802d273") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:34.446641 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.446622 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1f02c5_0706_4816_87f7_105c522ad7b8.slice/crio-93c78dca19933287f45290d01f76a01bb5a47a6ba28b55fbe6292db0e5148fbe WatchSource:0}: Error finding container 93c78dca19933287f45290d01f76a01bb5a47a6ba28b55fbe6292db0e5148fbe: Status 404 returned error can't find the container with id 93c78dca19933287f45290d01f76a01bb5a47a6ba28b55fbe6292db0e5148fbe Sep 15 17:30:34.454201 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.454181 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6640a792_9ce0_430e_95e4_4fb05d8fc231.slice/crio-f2f1da56aebaa39a6752239d2349770bc878fe0557961d05d8fd030b5827fd47 WatchSource:0}: Error finding container f2f1da56aebaa39a6752239d2349770bc878fe0557961d05d8fd030b5827fd47: Status 404 returned error can't find the container with id f2f1da56aebaa39a6752239d2349770bc878fe0557961d05d8fd030b5827fd47 Sep 15 17:30:34.454755 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.454732 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1874e1af_e942_44bf_92ec_5f5d42c2bb97.slice/crio-2b4ff77e29d64ed0822e69c3aceeb67008a17cc5ed29ea50b7afd7931c73d487 WatchSource:0}: Error finding container 2b4ff77e29d64ed0822e69c3aceeb67008a17cc5ed29ea50b7afd7931c73d487: Status 404 returned error can't find the container with id 2b4ff77e29d64ed0822e69c3aceeb67008a17cc5ed29ea50b7afd7931c73d487 Sep 15 17:30:34.477153 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.477132 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453b634f922d3bc29f446925d3a931fd.slice/crio-11c214ab8782e0c6c040e127fe32632789e98a71d411b879fe8485e642a3f7d8 WatchSource:0}: Error finding container 11c214ab8782e0c6c040e127fe32632789e98a71d411b879fe8485e642a3f7d8: Status 404 returned error can't find the container with id 11c214ab8782e0c6c040e127fe32632789e98a71d411b879fe8485e642a3f7d8 Sep 15 17:30:34.556984 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:30:34.556957 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3e6f01_bb44_4ffc_8bd3_03c965953454.slice/crio-017097dba363518fefc0c7639358b90821a36117d32c04a2e1f5c586a67dd11b WatchSource:0}: Error finding container 017097dba363518fefc0c7639358b90821a36117d32c04a2e1f5c586a67dd11b: Status 404 returned error can't find the container with id 017097dba363518fefc0c7639358b90821a36117d32c04a2e1f5c586a67dd11b Sep 15 17:30:34.665102 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.665008 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 17:25:33 +0000 UTC" deadline="2028-05-20 10:47:02.572456032 +0000 UTC" Sep 15 17:30:34.665102 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.665051 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14705h16m27.90740717s" Sep 15 17:30:34.736557 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.736534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:34.736656 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:34.736626 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:34.741154 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.741108 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" event={"ID":"4f5d4104f78662c719231b0e8fdcd77c","Type":"ContainerStarted","Data":"5f887ff6f2ec5745fabeb3eba5da1c5661126ec3342dd796a6f9ae2ba784cf1b"} Sep 15 17:30:34.742092 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.742060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" event={"ID":"453b634f922d3bc29f446925d3a931fd","Type":"ContainerStarted","Data":"11c214ab8782e0c6c040e127fe32632789e98a71d411b879fe8485e642a3f7d8"} Sep 15 17:30:34.743045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.743020 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-njxct" event={"ID":"1874e1af-e942-44bf-92ec-5f5d42c2bb97","Type":"ContainerStarted","Data":"2b4ff77e29d64ed0822e69c3aceeb67008a17cc5ed29ea50b7afd7931c73d487"} Sep 15 17:30:34.744124 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.744100 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jhrht" event={"ID":"8f1f02c5-0706-4816-87f7-105c522ad7b8","Type":"ContainerStarted","Data":"93c78dca19933287f45290d01f76a01bb5a47a6ba28b55fbe6292db0e5148fbe"} Sep 15 17:30:34.745127 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.745106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"cef4bc7f18528adefa77dda9cbeaacf7d8560b7dda72679eb0bfbbcf28411d78"} Sep 15 17:30:34.746165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.746148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerStarted","Data":"73e301e4f90840d8e069a441d5b2a7d2772a7fa26ea2baa6b09d8f283a8ec981"} Sep 15 17:30:34.747092 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.747057 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hkrrv" event={"ID":"be3e6f01-bb44-4ffc-8bd3-03c965953454","Type":"ContainerStarted","Data":"017097dba363518fefc0c7639358b90821a36117d32c04a2e1f5c586a67dd11b"} Sep 15 17:30:34.748020 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.748003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxf8d" event={"ID":"6640a792-9ce0-430e-95e4-4fb05d8fc231","Type":"ContainerStarted","Data":"f2f1da56aebaa39a6752239d2349770bc878fe0557961d05d8fd030b5827fd47"} Sep 15 17:30:34.749098 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.749066 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" event={"ID":"39de77f7-738d-4a4e-8bef-75e200987696","Type":"ContainerStarted","Data":"c4031653b4c6f37db65b105868ff49336b5b35781a0ea29d70a5e989136c3e4a"} Sep 15 17:30:34.750088 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:34.750055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6ftln" event={"ID":"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9","Type":"ContainerStarted","Data":"e3b52395361e96eb55ddfccc9fdc579a177df82fad65800ff9d6751e51092a20"} Sep 15 17:30:35.036290 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.036221 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:30:35.345652 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.345573 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:30:35.348617 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.348590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:35.348743 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.348666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:35.348804 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.348788 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:35.348860 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.348847 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:30:37.348829064 +0000 UTC m=+5.106940915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:35.349307 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.349212 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:35.349307 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.349262 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret podName:d408293d-1144-45a4-a887-c18aae4d190b nodeName:}" failed. No retries permitted until 2026-09-15 17:30:37.349247793 +0000 UTC m=+5.107359648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret") pod "global-pull-secret-syncer-h9bvw" (UID: "d408293d-1144-45a4-a887-c18aae4d190b") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:35.449890 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.449854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:35.450070 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.450018 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:30:35.450070 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.450041 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:30:35.450070 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.450053 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rfm2d for pod openshift-network-diagnostics/network-check-target-tkbgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:35.450276 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.450131 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d podName:04f55807-184b-4c00-9eb2-edc5c802d273 nodeName:}" failed. No retries permitted until 2026-09-15 17:30:37.450111428 +0000 UTC m=+5.208223302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfm2d" (UniqueName: "kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d") pod "network-check-target-tkbgj" (UID: "04f55807-184b-4c00-9eb2-edc5c802d273") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:35.665730 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.665627 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 17:25:33 +0000 UTC" deadline="2028-04-18 11:03:23.066518393 +0000 UTC" Sep 15 17:30:35.665730 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.665685 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13937h32m47.400837077s" Sep 15 17:30:35.737146 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.737114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:35.737314 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.737246 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:35.737680 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:35.737660 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:35.737789 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:35.737770 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:36.737241 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:36.737209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:36.737803 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:36.737340 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:36.785657 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:36.785619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mv6cw" event={"ID":"a0788f07-77c5-4d7d-906a-5682493a56f3","Type":"ContainerStarted","Data":"5d61cda5ce4de7d2d46322437e3b033d942e5d6a3dec30a176995c9e3703e920"} Sep 15 17:30:37.366042 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:37.366002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:37.366242 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:37.366092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:37.366307 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.366252 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:37.366366 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.366314 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret podName:d408293d-1144-45a4-a887-c18aae4d190b nodeName:}" failed. No retries permitted until 2026-09-15 17:30:41.366295894 +0000 UTC m=+9.124407757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret") pod "global-pull-secret-syncer-h9bvw" (UID: "d408293d-1144-45a4-a887-c18aae4d190b") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:37.366723 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.366699 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:37.366829 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.366755 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:30:41.366739903 +0000 UTC m=+9.124851758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:37.466523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:37.466478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:37.466759 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.466698 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:30:37.466759 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.466722 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:30:37.466759 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.466735 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rfm2d for pod openshift-network-diagnostics/network-check-target-tkbgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:37.466939 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.466838 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d podName:04f55807-184b-4c00-9eb2-edc5c802d273 nodeName:}" failed. No retries permitted until 2026-09-15 17:30:41.466780978 +0000 UTC m=+9.224892854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfm2d" (UniqueName: "kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d") pod "network-check-target-tkbgj" (UID: "04f55807-184b-4c00-9eb2-edc5c802d273") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:37.736700 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:37.736498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:37.736700 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.736650 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:37.737061 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:37.737022 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:37.737183 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:37.737144 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:38.737354 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:38.737322 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:38.737945 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:38.737485 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:39.737433 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:39.737375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:39.737908 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:39.737497 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:39.737908 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:39.737873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:39.738012 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:39.737974 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:40.737179 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:40.737140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:40.737455 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:40.737429 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:41.399448 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:41.399408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:41.399891 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:41.399508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:41.399891 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.399651 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:41.399891 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.399716 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:30:49.399696216 +0000 UTC m=+17.157808086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:41.400234 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.400198 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:41.400349 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.400261 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret podName:d408293d-1144-45a4-a887-c18aae4d190b nodeName:}" failed. No retries permitted until 2026-09-15 17:30:49.400243496 +0000 UTC m=+17.158355346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret") pod "global-pull-secret-syncer-h9bvw" (UID: "d408293d-1144-45a4-a887-c18aae4d190b") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:41.500458 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:41.499844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:41.500458 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.500031 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:30:41.500458 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.500049 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:30:41.500458 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.500061 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rfm2d for pod openshift-network-diagnostics/network-check-target-tkbgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:41.500458 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.500131 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d podName:04f55807-184b-4c00-9eb2-edc5c802d273 nodeName:}" failed. No retries permitted until 2026-09-15 17:30:49.500112218 +0000 UTC m=+17.258224080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfm2d" (UniqueName: "kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d") pod "network-check-target-tkbgj" (UID: "04f55807-184b-4c00-9eb2-edc5c802d273") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:41.737021 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:41.736947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:41.737021 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:41.736987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:41.737259 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.737136 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:41.737318 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:41.737274 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:42.737918 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:42.737881 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:42.738381 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:42.737997 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:43.737108 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:43.736942 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:43.737108 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:43.737071 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:43.737108 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:43.736953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:43.737399 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:43.737198 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:44.737208 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:44.737169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:44.737609 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:44.737303 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:45.736845 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:45.736817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:45.737023 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:45.736819 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:45.737023 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:45.736901 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:45.737023 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:45.736984 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:46.737087 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:46.736986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:46.737645 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:46.737139 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:47.737389 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:47.737346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:47.737804 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:47.737361 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:47.737804 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:47.737470 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:47.737804 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:47.737576 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:48.737160 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:48.737131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:48.737332 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:48.737241 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:49.457892 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:49.457871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:49.458157 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:49.457919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:49.458157 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.457965 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:49.458157 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.457994 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:49.458157 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.458019 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret podName:d408293d-1144-45a4-a887-c18aae4d190b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:05.45800462 +0000 UTC m=+33.216116473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret") pod "global-pull-secret-syncer-h9bvw" (UID: "d408293d-1144-45a4-a887-c18aae4d190b") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:30:49.458157 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.458033 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:31:05.458026164 +0000 UTC m=+33.216138013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:30:49.559056 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:49.559020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:49.559230 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.559209 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:30:49.559230 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.559229 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:30:49.559310 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.559239 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rfm2d for pod openshift-network-diagnostics/network-check-target-tkbgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:49.559310 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.559293 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d podName:04f55807-184b-4c00-9eb2-edc5c802d273 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:05.559276651 +0000 UTC m=+33.317388516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfm2d" (UniqueName: "kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d") pod "network-check-target-tkbgj" (UID: "04f55807-184b-4c00-9eb2-edc5c802d273") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:30:49.737227 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:49.737158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:49.737387 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:49.737161 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:49.737387 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.737277 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:49.737486 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:49.737387 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:50.736848 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:50.736818 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:50.737272 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:50.736937 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:51.736503 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:51.736476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:51.736503 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:51.736490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:51.736759 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:51.736593 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:51.736759 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:51.736691 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:52.737299 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:52.737272 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:52.737704 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:52.737361 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:53.736614 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.736588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:53.736743 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.736588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:53.736743 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:53.736692 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:53.736814 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:53.736780 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:53.821188 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.821113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" event={"ID":"4f5d4104f78662c719231b0e8fdcd77c","Type":"ContainerStarted","Data":"a6757be96cac009a28dbc843ccc98b501afceade42fdb9736677609b9e0968eb"} Sep 15 17:30:53.822642 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.822615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-njxct" event={"ID":"1874e1af-e942-44bf-92ec-5f5d42c2bb97","Type":"ContainerStarted","Data":"ff8aba37409dc653941ff1d35fb6ff5bf98487b5fb4ea8724b49a8f76b12e5ee"} Sep 15 17:30:53.823994 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.823969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jhrht" event={"ID":"8f1f02c5-0706-4816-87f7-105c522ad7b8","Type":"ContainerStarted","Data":"5463fb954ece98e6b6b1a25e3e44b5f14e2e8d0a8eb9d5adb860521e91b2170d"} Sep 15 17:30:53.835819 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.835777 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" podStartSLOduration=20.835764128 podStartE2EDuration="20.835764128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:53.835295393 +0000 UTC m=+21.593407263" watchObservedRunningTime="2026-09-15 17:30:53.835764128 +0000 UTC m=+21.593875999" Sep 15 17:30:53.850536 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.850499 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-njxct" podStartSLOduration=2.9311620019999998 podStartE2EDuration="21.850484682s" totalImagesPullingTime="18.91932268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:53.850230662 +0000 UTC m=+21.608342533" watchObservedRunningTime="2026-09-15 17:30:53.850484682 +0000 UTC m=+21.608596552" Sep 15 17:30:53.865269 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:53.865226 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jhrht" podStartSLOduration=2.902099391 podStartE2EDuration="21.865213053s" totalImagesPullingTime="18.963113662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:53.865007954 +0000 UTC m=+21.623119825" watchObservedRunningTime="2026-09-15 17:30:53.865213053 +0000 UTC m=+21.623324925" Sep 15 17:30:54.736735 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.736560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:54.736880 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:54.736803 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:54.827034 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.826963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxf8d" event={"ID":"6640a792-9ce0-430e-95e4-4fb05d8fc231","Type":"ContainerStarted","Data":"1b5ca2bd283265ff4fc0b4bb82de1a542c1b90eb3a4f6a8f4f823cd18d7c32c6"} Sep 15 17:30:54.828792 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.828763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" event={"ID":"39de77f7-738d-4a4e-8bef-75e200987696","Type":"ContainerStarted","Data":"a3fb1c5c299306e92d719ce1fa71917f67b38c4ef8549388c28ad9363c8c87e2"} Sep 15 17:30:54.830421 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.830395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6ftln" event={"ID":"0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9","Type":"ContainerStarted","Data":"d9957c803f48b1db61907db53b61b23cd17ea250de5e4f3463da1c7abc253457"} Sep 15 17:30:54.832344 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.832317 2562 generic.go:356] "Generic (PLEG): container finished" podID="453b634f922d3bc29f446925d3a931fd" containerID="167a20e8fd3881ae9d22859a5a0fd1f41e2a0fc916e170870b7c10da34028ea5" exitCode=0 Sep 15 17:30:54.832464 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.832404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" event={"ID":"453b634f922d3bc29f446925d3a931fd","Type":"ContainerDied","Data":"167a20e8fd3881ae9d22859a5a0fd1f41e2a0fc916e170870b7c10da34028ea5"} Sep 15 17:30:54.835976 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.835955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"e6e97056dc68d3985e7d3ea5b4e7812471dc2e2d85673a6e6c1949201ad87e14"} Sep 15 17:30:54.836108 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.836018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"127f5a8f706b33c4dfad6365f7c26752d18896ba4018e07c7c42307721728ed8"} Sep 15 17:30:54.836108 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.836062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"dd83ce7f8d188ffa7018244f2c100af3c999833252ae73d47cf1873360822e7f"} Sep 15 17:30:54.836229 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.836169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"2e62656c0bc44883a3f9080cb707fcb991309299c2512628ef529e8de1297693"} Sep 15 17:30:54.836229 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.836223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"2bce0bc26a473655e009b51ace144e8f04088d9d24ab0d7c6782769143eaca98"} Sep 15 17:30:54.836329 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.836268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"fd1deb5c6694a69ed4660095c6e422051a82a95094500701b224ca9a49c6d3de"} Sep 15 17:30:54.837710 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.837685 2562 generic.go:356] "Generic (PLEG): container finished" podID="53bfa278-4cbe-4ba2-89c5-8d45bb954e77" containerID="2bcf6880a1eb8f157ffdfce5a61fdfd92df4152c0dd6c11f9ae3798ea5394b16" exitCode=0 Sep 15 17:30:54.837796 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.837760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerDied","Data":"2bcf6880a1eb8f157ffdfce5a61fdfd92df4152c0dd6c11f9ae3798ea5394b16"} Sep 15 17:30:54.839412 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.839381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hkrrv" event={"ID":"be3e6f01-bb44-4ffc-8bd3-03c965953454","Type":"ContainerStarted","Data":"8f70f8ec1555adc45bbd1ee4b255347e0659e195766d67e1dc035246995a1795"} Sep 15 17:30:54.843263 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.843226 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lxf8d" podStartSLOduration=3.951729467 podStartE2EDuration="22.843213581s" totalImagesPullingTime="18.891484114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:54.842727734 +0000 UTC m=+22.600839606" watchObservedRunningTime="2026-09-15 17:30:54.843213581 +0000 UTC m=+22.601325451" Sep 15 17:30:54.856219 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.856183 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hkrrv" podStartSLOduration=4.067482941 podStartE2EDuration="22.856172553s" totalImagesPullingTime="18.788689612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:54.855857629 +0000 UTC m=+22.613969502" watchObservedRunningTime="2026-09-15 17:30:54.856172553 +0000 UTC m=+22.614284434" Sep 15 17:30:54.869648 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:54.869602 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6ftln" podStartSLOduration=3.910689658 podStartE2EDuration="22.869582972s" totalImagesPullingTime="18.958893314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:54.869126397 +0000 UTC m=+22.627238271" watchObservedRunningTime="2026-09-15 17:30:54.869582972 +0000 UTC m=+22.627694845" Sep 15 17:30:55.651853 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.651698 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 17:30:55.702429 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.702310 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T17:30:55.651850452Z","UUID":"d2fb858f-50b7-4afd-97e2-4af9f0bab9d6","Handler":null,"Name":"","Endpoint":""} Sep 15 17:30:55.707115 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.707072 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 17:30:55.707196 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.707126 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 17:30:55.737228 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.737206 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:55.737369 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.737232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:55.737369 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:55.737309 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:55.737474 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:55.737451 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:55.843677 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.843597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" event={"ID":"39de77f7-738d-4a4e-8bef-75e200987696","Type":"ContainerStarted","Data":"2aec0e5cfb3ba913f22abfb467bb66216fe095febbb79e2627c98780b39c8106"} Sep 15 17:30:55.845734 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.845706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" event={"ID":"453b634f922d3bc29f446925d3a931fd","Type":"ContainerStarted","Data":"b91871b4cf95a0b7e32a1c92806fcbf6aed25e97f89f0d9cfdc838c550ce7f19"} Sep 15 17:30:55.846990 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.846956 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:55.847499 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.847469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mv6cw" event={"ID":"a0788f07-77c5-4d7d-906a-5682493a56f3","Type":"ContainerStarted","Data":"f178f1791769c0f62be20f2f308304b97fad9fd4c5de027355202368d9ce7731"} Sep 15 17:30:55.847760 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.847741 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:55.848164 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.848125 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:55.848516 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.848497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lxf8d" Sep 15 17:30:55.861816 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.861770 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" podStartSLOduration=22.861754744 podStartE2EDuration="22.861754744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:55.861674517 +0000 UTC m=+23.619786388" watchObservedRunningTime="2026-09-15 17:30:55.861754744 +0000 UTC m=+23.619866630" Sep 15 17:30:55.888503 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:55.888463 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mv6cw" podStartSLOduration=6.361272965 podStartE2EDuration="23.888451417s" totalImagesPullingTime="17.527178452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:55.88843292 +0000 UTC m=+23.646544791" watchObservedRunningTime="2026-09-15 17:30:55.888451417 +0000 UTC m=+23.646563288" Sep 15 17:30:56.736532 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:56.736507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:56.736643 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:56.736623 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:56.854479 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:56.854432 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"e0bd575761252c9cdfd98a62ea79b8b937bf463246913e3e3bbd9765d2803fef"} Sep 15 17:30:57.737176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:57.737147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:57.737365 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:57.737246 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:57.737365 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:57.737306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:57.737477 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:57.737420 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:58.737294 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:58.737263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:30:58.737801 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:58.737374 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:30:58.860773 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:58.860738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" event={"ID":"39de77f7-738d-4a4e-8bef-75e200987696","Type":"ContainerStarted","Data":"5d271509570ab8b495f055f0bc048df490e34fa54c42fdd1b6982584550db26d"} Sep 15 17:30:58.876841 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:58.876787 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-495j5" podStartSLOduration=4.214682051 podStartE2EDuration="26.876765873s" totalImagesPullingTime="22.662083822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:58.876154559 +0000 UTC m=+26.634266428" watchObservedRunningTime="2026-09-15 17:30:58.876765873 +0000 UTC m=+26.634877744" Sep 15 17:30:59.737255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:59.737054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:30:59.737409 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:59.737054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:30:59.737409 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:59.737358 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:30:59.737835 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:30:59.737451 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:30:59.867218 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:30:59.867179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" event={"ID":"4c48329a-81ec-4235-8baf-a50cd9d9babb","Type":"ContainerStarted","Data":"eecd3014dd7c424c5b1ea6ab6c9fd0bee220dfcfc53ffbcd5daac10e56f7b32a"} Sep 15 17:31:00.737041 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.737019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:00.737169 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:00.737138 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:31:00.763547 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.763495 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" podStartSLOduration=9.270819389 podStartE2EDuration="28.763472056s" totalImagesPullingTime="19.492652667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:30:59.896828111 +0000 UTC m=+27.654940002" watchObservedRunningTime="2026-09-15 17:31:00.763472056 +0000 UTC m=+28.521583928" Sep 15 17:31:00.764155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.763965 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9wkp"] Sep 15 17:31:00.764155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.764094 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:31:00.764252 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:00.764226 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:31:00.764813 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.764793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9bvw"] Sep 15 17:31:00.764916 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.764880 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:00.764986 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:00.764967 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:31:00.778715 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.778666 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tkbgj"] Sep 15 17:31:00.871471 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.871433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerStarted","Data":"91adbfc8165445994a5dd6a98ca7c3ea1deffe0f01bd94179bb88bff167dea8e"} Sep 15 17:31:00.871617 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.871452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:00.872167 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.872138 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:31:00.872265 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.872202 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:31:00.872265 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:00.872134 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:31:00.872265 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.872242 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:31:00.886990 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.886968 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:31:00.887390 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:00.887365 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:31:01.875318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:01.875283 2562 generic.go:356] "Generic (PLEG): container finished" podID="53bfa278-4cbe-4ba2-89c5-8d45bb954e77" containerID="91adbfc8165445994a5dd6a98ca7c3ea1deffe0f01bd94179bb88bff167dea8e" exitCode=0 Sep 15 17:31:01.875842 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:01.875369 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerDied","Data":"91adbfc8165445994a5dd6a98ca7c3ea1deffe0f01bd94179bb88bff167dea8e"} Sep 15 17:31:02.737944 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:02.737916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:31:02.738109 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:02.737999 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:31:02.738109 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:02.738023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:02.738201 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:02.738151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:31:02.738201 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:02.738184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:02.738325 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:02.738307 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:31:03.881813 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:03.881521 2562 generic.go:356] "Generic (PLEG): container finished" podID="53bfa278-4cbe-4ba2-89c5-8d45bb954e77" containerID="bb0439472e10cd3242413c1c58ae97e68d432c4c065b67d4764addc62ddeea61" exitCode=0 Sep 15 17:31:03.881813 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:03.881594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerDied","Data":"bb0439472e10cd3242413c1c58ae97e68d432c4c065b67d4764addc62ddeea61"} Sep 15 17:31:04.736498 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:04.736471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:31:04.736498 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:04.736485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:04.736696 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:04.736471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:04.736696 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:04.736577 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:31:04.736696 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:04.736634 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:31:04.736806 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:04.736725 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:31:05.477037 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:05.477004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:31:05.477384 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:05.477049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:05.477384 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.477159 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:05.477384 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.477159 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:05.477384 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.477217 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret podName:d408293d-1144-45a4-a887-c18aae4d190b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:37.477200411 +0000 UTC m=+65.235312261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret") pod "global-pull-secret-syncer-h9bvw" (UID: "d408293d-1144-45a4-a887-c18aae4d190b") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:05.477384 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.477238 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:31:37.477224053 +0000 UTC m=+65.235335917 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:05.577466 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:05.577401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:05.577578 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.577509 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:05.577578 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.577525 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:05.577578 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.577533 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rfm2d for pod openshift-network-diagnostics/network-check-target-tkbgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:05.577578 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:05.577575 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d podName:04f55807-184b-4c00-9eb2-edc5c802d273 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:37.577563235 +0000 UTC m=+65.335675097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfm2d" (UniqueName: "kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d") pod "network-check-target-tkbgj" (UID: "04f55807-184b-4c00-9eb2-edc5c802d273") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:05.887860 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:05.887788 2562 generic.go:356] "Generic (PLEG): container finished" podID="53bfa278-4cbe-4ba2-89c5-8d45bb954e77" containerID="4c3e78d67c51fe93b68f3f4c990c1be08c7b03ad839a87d8fadf5cbec35804e5" exitCode=0 Sep 15 17:31:05.887860 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:05.887842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerDied","Data":"4c3e78d67c51fe93b68f3f4c990c1be08c7b03ad839a87d8fadf5cbec35804e5"} Sep 15 17:31:06.737366 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:06.737338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:06.737366 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:06.737354 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:31:06.737888 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:06.737338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:06.737888 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:06.737458 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9bvw" podUID="d408293d-1144-45a4-a887-c18aae4d190b" Sep 15 17:31:06.737888 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:06.737583 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tkbgj" podUID="04f55807-184b-4c00-9eb2-edc5c802d273" Sep 15 17:31:06.737888 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:06.737659 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:31:07.523405 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.523325 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeReady" Sep 15 17:31:07.523606 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.523494 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 17:31:07.567992 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.567961 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mlfv9"] Sep 15 17:31:07.589259 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.589233 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wszgt"] Sep 15 17:31:07.589396 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.589370 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.591661 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.591635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 17:31:07.591661 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.591653 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 17:31:07.591842 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.591667 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vrkqb\"" Sep 15 17:31:07.613314 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.613272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mlfv9"] Sep 15 17:31:07.613314 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.613308 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wszgt"] Sep 15 17:31:07.613588 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.613393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:07.616348 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.616327 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 17:31:07.616470 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.616391 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n2lgd\"" Sep 15 17:31:07.616470 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.616407 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 17:31:07.616577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.616511 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 17:31:07.692061 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.692030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scmnq\" (UniqueName: \"kubernetes.io/projected/65bdb16b-3b25-40e1-98a4-c3b408fc4585-kube-api-access-scmnq\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.692236 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.692066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.692236 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.692139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2c7l\" (UniqueName: \"kubernetes.io/projected/8bd294ad-7258-4423-b335-7bc32eb366ca-kube-api-access-k2c7l\") pod \"ingress-canary-wszgt\" (UID: \"8bd294ad-7258-4423-b335-7bc32eb366ca\") " pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:07.692236 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.692161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65bdb16b-3b25-40e1-98a4-c3b408fc4585-config-volume\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.692236 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.692201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65bdb16b-3b25-40e1-98a4-c3b408fc4585-tmp-dir\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.692386 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.692246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bd294ad-7258-4423-b335-7bc32eb366ca-cert\") pod \"ingress-canary-wszgt\" (UID: \"8bd294ad-7258-4423-b335-7bc32eb366ca\") " pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:07.792809 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.792737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scmnq\" (UniqueName: \"kubernetes.io/projected/65bdb16b-3b25-40e1-98a4-c3b408fc4585-kube-api-access-scmnq\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.792809 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.792779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.793329 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:07.792880 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:07.793329 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.792910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c7l\" (UniqueName: \"kubernetes.io/projected/8bd294ad-7258-4423-b335-7bc32eb366ca-kube-api-access-k2c7l\") pod \"ingress-canary-wszgt\" (UID: \"8bd294ad-7258-4423-b335-7bc32eb366ca\") " pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:07.793329 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:07.792936 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:08.292917202 +0000 UTC m=+36.051029068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:31:07.793329 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.792959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65bdb16b-3b25-40e1-98a4-c3b408fc4585-config-volume\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.793329 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.792984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65bdb16b-3b25-40e1-98a4-c3b408fc4585-tmp-dir\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.793329 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.793046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bd294ad-7258-4423-b335-7bc32eb366ca-cert\") pod \"ingress-canary-wszgt\" (UID: \"8bd294ad-7258-4423-b335-7bc32eb366ca\") " pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:07.793617 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.793512 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65bdb16b-3b25-40e1-98a4-c3b408fc4585-tmp-dir\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.793617 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.793545 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65bdb16b-3b25-40e1-98a4-c3b408fc4585-config-volume\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.798011 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.797860 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bd294ad-7258-4423-b335-7bc32eb366ca-cert\") pod \"ingress-canary-wszgt\" (UID: \"8bd294ad-7258-4423-b335-7bc32eb366ca\") " pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:07.801968 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.801920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scmnq\" (UniqueName: \"kubernetes.io/projected/65bdb16b-3b25-40e1-98a4-c3b408fc4585-kube-api-access-scmnq\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:07.802183 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.801990 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2c7l\" (UniqueName: \"kubernetes.io/projected/8bd294ad-7258-4423-b335-7bc32eb366ca-kube-api-access-k2c7l\") pod \"ingress-canary-wszgt\" (UID: \"8bd294ad-7258-4423-b335-7bc32eb366ca\") " pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:07.923536 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:07.923499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wszgt" Sep 15 17:31:08.251256 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.251184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wszgt"] Sep 15 17:31:08.255438 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:31:08.255410 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd294ad_7258_4423_b335_7bc32eb366ca.slice/crio-0a8c69500afe01732d784c09f1d6c560bb485c872faf50c48216b8f5036835be WatchSource:0}: Error finding container 0a8c69500afe01732d784c09f1d6c560bb485c872faf50c48216b8f5036835be: Status 404 returned error can't find the container with id 0a8c69500afe01732d784c09f1d6c560bb485c872faf50c48216b8f5036835be Sep 15 17:31:08.297259 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.297232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:08.297418 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:08.297390 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:08.297458 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:08.297452 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:09.297436793 +0000 UTC m=+37.055548643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:31:08.736685 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.736653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:08.736685 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.736671 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:31:08.736864 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.736653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:08.740675 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.739836 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 17:31:08.740911 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.740893 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 17:31:08.741029 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.740943 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 17:31:08.741686 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.741669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xh7q9\"" Sep 15 17:31:08.741809 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.741795 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 17:31:08.741879 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.741795 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wlv8h\"" Sep 15 17:31:08.896530 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:08.896492 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wszgt" event={"ID":"8bd294ad-7258-4423-b335-7bc32eb366ca","Type":"ContainerStarted","Data":"0a8c69500afe01732d784c09f1d6c560bb485c872faf50c48216b8f5036835be"} Sep 15 17:31:09.305483 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:09.305447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:09.305671 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:09.305630 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:09.305740 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:09.305716 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:11.305694232 +0000 UTC m=+39.063806081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:31:11.323264 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:11.323228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:11.323854 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:11.323407 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:11.323854 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:11.323486 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:15.323464497 +0000 UTC m=+43.081576366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:31:13.911443 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:13.911401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wszgt" event={"ID":"8bd294ad-7258-4423-b335-7bc32eb366ca","Type":"ContainerStarted","Data":"1d2f122a023b11abfc2069850d4c978c257514ee43ce486f21d7107dd82be686"} Sep 15 17:31:13.913902 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:13.913882 2562 generic.go:356] "Generic (PLEG): container finished" podID="53bfa278-4cbe-4ba2-89c5-8d45bb954e77" containerID="899d1a09c17ef0684b8fae4f4f91de4facc8b37e7f0fb66462ba7372437c8a50" exitCode=0 Sep 15 17:31:13.913985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:13.913917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerDied","Data":"899d1a09c17ef0684b8fae4f4f91de4facc8b37e7f0fb66462ba7372437c8a50"} Sep 15 17:31:13.926777 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:13.926732 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wszgt" podStartSLOduration=2.373876287 podStartE2EDuration="6.926719982s" totalImagesPullingTime="4.552843695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:13.925709069 +0000 UTC m=+41.683820941" watchObservedRunningTime="2026-09-15 17:31:13.926719982 +0000 UTC m=+41.684831853" Sep 15 17:31:14.918723 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:14.918689 2562 generic.go:356] "Generic (PLEG): container finished" podID="53bfa278-4cbe-4ba2-89c5-8d45bb954e77" containerID="4d94852fb26f8e7283dd8732cd80e5c89beb9ba483c94b435f42a2245f06e1ef" exitCode=0 Sep 15 17:31:14.919153 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:14.918786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerDied","Data":"4d94852fb26f8e7283dd8732cd80e5c89beb9ba483c94b435f42a2245f06e1ef"} Sep 15 17:31:15.354265 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:15.354232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:15.354417 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:15.354354 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:15.354417 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:15.354403 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:23.354390387 +0000 UTC m=+51.112502237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:31:15.924774 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:15.924740 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz89h" event={"ID":"53bfa278-4cbe-4ba2-89c5-8d45bb954e77","Type":"ContainerStarted","Data":"084cf100d10af13bcf1f4342f00a6e36cfbe960fd7d5062d2a4bcab7747c3e81"} Sep 15 17:31:15.945614 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:15.945570 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gz89h" podStartSLOduration=9.174110216 podStartE2EDuration="43.945556656s" totalImagesPullingTime="34.77144644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:15.944300112 +0000 UTC m=+43.702411982" watchObservedRunningTime="2026-09-15 17:31:15.945556656 +0000 UTC m=+43.703668526" Sep 15 17:31:23.405412 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:23.405358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:23.405892 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:23.405520 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:23.405892 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:23.405599 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:39.405582399 +0000 UTC m=+67.163694253 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:31:32.896022 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:32.895994 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnqzm" Sep 15 17:31:37.498541 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.498505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:31:37.498920 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.498561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:37.503244 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.503224 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 17:31:37.503336 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.503251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 17:31:37.509289 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:37.509264 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 15 17:31:37.509389 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:37.509341 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:32:41.509321591 +0000 UTC m=+129.267433439 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : secret "metrics-daemon-secret" not found Sep 15 17:31:37.511827 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.511810 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d408293d-1144-45a4-a887-c18aae4d190b-original-pull-secret\") pod \"global-pull-secret-syncer-h9bvw\" (UID: \"d408293d-1144-45a4-a887-c18aae4d190b\") " pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:37.549117 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.549058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9bvw" Sep 15 17:31:37.599602 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.599575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:37.602266 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.602246 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 17:31:37.612407 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.612388 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 17:31:37.622377 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.622357 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfm2d\" (UniqueName: \"kubernetes.io/projected/04f55807-184b-4c00-9eb2-edc5c802d273-kube-api-access-rfm2d\") pod \"network-check-target-tkbgj\" (UID: \"04f55807-184b-4c00-9eb2-edc5c802d273\") " pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:37.813838 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.813771 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9bvw"] Sep 15 17:31:37.816779 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:31:37.816754 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd408293d_1144_45a4_a887_c18aae4d190b.slice/crio-341b9b8fc411c1c55ab7b535e4da104a865c905742869333cb29bcb6f3dc2681 WatchSource:0}: Error finding container 341b9b8fc411c1c55ab7b535e4da104a865c905742869333cb29bcb6f3dc2681: Status 404 returned error can't find the container with id 341b9b8fc411c1c55ab7b535e4da104a865c905742869333cb29bcb6f3dc2681 Sep 15 17:31:37.857634 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.857608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wlv8h\"" Sep 15 17:31:37.865433 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.865402 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:37.974966 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:37.974934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9bvw" event={"ID":"d408293d-1144-45a4-a887-c18aae4d190b","Type":"ContainerStarted","Data":"341b9b8fc411c1c55ab7b535e4da104a865c905742869333cb29bcb6f3dc2681"} Sep 15 17:31:38.130333 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:38.130224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tkbgj"] Sep 15 17:31:38.132505 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:31:38.132480 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f55807_184b_4c00_9eb2_edc5c802d273.slice/crio-36d17a31e2b4880dd1df18198ac7f08b93ee1aaae76a0e9b598b8f6b17f20565 WatchSource:0}: Error finding container 36d17a31e2b4880dd1df18198ac7f08b93ee1aaae76a0e9b598b8f6b17f20565: Status 404 returned error can't find the container with id 36d17a31e2b4880dd1df18198ac7f08b93ee1aaae76a0e9b598b8f6b17f20565 Sep 15 17:31:38.979206 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:38.979163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tkbgj" event={"ID":"04f55807-184b-4c00-9eb2-edc5c802d273","Type":"ContainerStarted","Data":"36d17a31e2b4880dd1df18198ac7f08b93ee1aaae76a0e9b598b8f6b17f20565"} Sep 15 17:31:39.412754 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:39.412674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:31:39.412910 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:39.412845 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:39.412962 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:31:39.412927 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:11.412905742 +0000 UTC m=+99.171017597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:31:40.006106 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.005871 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn"] Sep 15 17:31:40.008070 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.008047 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:40.010494 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.010456 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 15 17:31:40.010494 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.010463 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 15 17:31:40.011668 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.011645 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xkj6k\"" Sep 15 17:31:40.011762 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.011727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 15 17:31:40.011814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.011658 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 15 17:31:40.016477 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.016448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/634a7791-7501-434a-a134-c08ce331caf1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5457db88b4-g5kcn\" (UID: \"634a7791-7501-434a-a134-c08ce331caf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:40.016582 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.016525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5nn\" (UniqueName: \"kubernetes.io/projected/634a7791-7501-434a-a134-c08ce331caf1-kube-api-access-nl5nn\") pod \"managed-serviceaccount-addon-agent-5457db88b4-g5kcn\" (UID: \"634a7791-7501-434a-a134-c08ce331caf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:40.017367 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.017345 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn"] Sep 15 17:31:40.117456 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.117422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/634a7791-7501-434a-a134-c08ce331caf1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5457db88b4-g5kcn\" (UID: \"634a7791-7501-434a-a134-c08ce331caf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:40.117611 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.117492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5nn\" (UniqueName: \"kubernetes.io/projected/634a7791-7501-434a-a134-c08ce331caf1-kube-api-access-nl5nn\") pod \"managed-serviceaccount-addon-agent-5457db88b4-g5kcn\" (UID: \"634a7791-7501-434a-a134-c08ce331caf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:40.120158 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.120128 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/634a7791-7501-434a-a134-c08ce331caf1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5457db88b4-g5kcn\" (UID: \"634a7791-7501-434a-a134-c08ce331caf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:40.126511 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.126483 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5nn\" (UniqueName: \"kubernetes.io/projected/634a7791-7501-434a-a134-c08ce331caf1-kube-api-access-nl5nn\") pod \"managed-serviceaccount-addon-agent-5457db88b4-g5kcn\" (UID: \"634a7791-7501-434a-a134-c08ce331caf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:40.324692 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:40.324609 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" Sep 15 17:31:42.817591 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:42.817514 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn"] Sep 15 17:31:42.820214 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:31:42.820172 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod634a7791_7501_434a_a134_c08ce331caf1.slice/crio-814e07f322763fd3dc57385128a247582220afdc0f6ce54725405f33c96d80ec WatchSource:0}: Error finding container 814e07f322763fd3dc57385128a247582220afdc0f6ce54725405f33c96d80ec: Status 404 returned error can't find the container with id 814e07f322763fd3dc57385128a247582220afdc0f6ce54725405f33c96d80ec Sep 15 17:31:42.991235 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:42.991202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9bvw" event={"ID":"d408293d-1144-45a4-a887-c18aae4d190b","Type":"ContainerStarted","Data":"be8e83118edd5efda9f8f7e08a5799dea5480a230aa308ff6d70b0c87b19ce20"} Sep 15 17:31:42.992349 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:42.992322 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" event={"ID":"634a7791-7501-434a-a134-c08ce331caf1","Type":"ContainerStarted","Data":"814e07f322763fd3dc57385128a247582220afdc0f6ce54725405f33c96d80ec"} Sep 15 17:31:42.993782 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:42.993748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tkbgj" event={"ID":"04f55807-184b-4c00-9eb2-edc5c802d273","Type":"ContainerStarted","Data":"95ec6a584b5be2a867744740eefbf1c0ece43d71f83848f1547bce7bdb2fbb6a"} Sep 15 17:31:42.993899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:42.993882 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:31:43.005784 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:43.005741 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h9bvw" podStartSLOduration=66.265638796 podStartE2EDuration="1m11.005727932s" totalImagesPullingTime="4.740089136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:43.004952799 +0000 UTC m=+70.763064670" watchObservedRunningTime="2026-09-15 17:31:43.005727932 +0000 UTC m=+70.763839803" Sep 15 17:31:43.018001 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:43.017963 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tkbgj" podStartSLOduration=66.597110807 podStartE2EDuration="1m11.017950378s" totalImagesPullingTime="4.420839571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:43.017931569 +0000 UTC m=+70.776043440" watchObservedRunningTime="2026-09-15 17:31:43.017950378 +0000 UTC m=+70.776062248" Sep 15 17:31:47.005741 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:47.005708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" event={"ID":"634a7791-7501-434a-a134-c08ce331caf1","Type":"ContainerStarted","Data":"7f4330da5709fca95ac22dc443bef94d4768c2a8a6972dd7ffca7b74027e0166"} Sep 15 17:31:47.020878 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:31:47.020830 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" podStartSLOduration=4.748230749 podStartE2EDuration="8.020815296s" totalImagesPullingTime="3.272584547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:47.020310785 +0000 UTC m=+74.778422657" watchObservedRunningTime="2026-09-15 17:31:47.020815296 +0000 UTC m=+74.778927167" Sep 15 17:32:11.420855 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:32:11.420810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:32:11.421337 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:32:11.420951 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:32:11.421337 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:32:11.421019 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:33:15.421005814 +0000 UTC m=+163.179117677 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:32:13.999207 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:32:13.999176 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tkbgj" Sep 15 17:32:41.515696 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:32:41.515641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:32:41.516220 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:32:41.515788 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 15 17:32:41.516220 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:32:41.515853 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs podName:d94489f1-50e8-4935-a293-149b65aa4c7f nodeName:}" failed. No retries permitted until 2026-09-15 17:34:43.51583774 +0000 UTC m=+251.273949594 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs") pod "network-metrics-daemon-b9wkp" (UID: "d94489f1-50e8-4935-a293-149b65aa4c7f") : secret "metrics-daemon-secret" not found Sep 15 17:33:10.598104 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:33:10.597995 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mlfv9" podUID="65bdb16b-3b25-40e1-98a4-c3b408fc4585" Sep 15 17:33:11.204895 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:33:11.204868 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlfv9" Sep 15 17:33:11.759765 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:33:11.759731 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b9wkp" podUID="d94489f1-50e8-4935-a293-149b65aa4c7f" Sep 15 17:33:15.433261 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:33:15.433212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:33:15.433645 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:33:15.433359 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:33:15.433645 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:33:15.433434 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls podName:65bdb16b-3b25-40e1-98a4-c3b408fc4585 nodeName:}" failed. No retries permitted until 2026-09-15 17:35:17.433418424 +0000 UTC m=+285.191530273 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls") pod "dns-default-mlfv9" (UID: "65bdb16b-3b25-40e1-98a4-c3b408fc4585") : secret "dns-default-metrics-tls" not found Sep 15 17:33:23.737276 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:33:23.737232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:33:46.290652 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:33:46.290616 2562 generic.go:356] "Generic (PLEG): container finished" podID="634a7791-7501-434a-a134-c08ce331caf1" containerID="7f4330da5709fca95ac22dc443bef94d4768c2a8a6972dd7ffca7b74027e0166" exitCode=255 Sep 15 17:33:46.291007 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:33:46.290690 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" event={"ID":"634a7791-7501-434a-a134-c08ce331caf1","Type":"ContainerDied","Data":"7f4330da5709fca95ac22dc443bef94d4768c2a8a6972dd7ffca7b74027e0166"} Sep 15 17:33:46.291007 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:33:46.290987 2562 scope.go:117] "RemoveContainer" containerID="7f4330da5709fca95ac22dc443bef94d4768c2a8a6972dd7ffca7b74027e0166" Sep 15 17:33:47.294583 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:33:47.294543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5457db88b4-g5kcn" event={"ID":"634a7791-7501-434a-a134-c08ce331caf1","Type":"ContainerStarted","Data":"0a084c48b9fbbf65385c38e8c3d77cb74f47d10009de7088d8004172435d375e"} Sep 15 17:34:25.558954 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.558923 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6777464cb4-nw5hb"] Sep 15 17:34:25.560814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.560797 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.563418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.563396 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 15 17:34:25.563519 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.563456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 15 17:34:25.564213 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.564197 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 15 17:34:25.564335 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.564318 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 15 17:34:25.564378 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.564366 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 15 17:34:25.564850 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.564836 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtdl7\"" Sep 15 17:34:25.564910 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.564898 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 15 17:34:25.579460 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.579439 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6777464cb4-nw5hb"] Sep 15 17:34:25.599399 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.599372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.599399 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.599399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47jpg\" (UniqueName: \"kubernetes.io/projected/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-kube-api-access-47jpg\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.599555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.599428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-default-certificate\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.599555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.599451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.599555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.599515 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-stats-auth\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.656495 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.656463 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-n9bgp"] Sep 15 17:34:25.658274 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.658253 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v"] Sep 15 17:34:25.658407 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.658388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.660129 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.660110 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8"] Sep 15 17:34:25.660218 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.660208 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:25.661768 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.661752 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ddd67bbd6-l94kl"] Sep 15 17:34:25.661953 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.661940 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.662753 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.662734 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 15 17:34:25.662849 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.662736 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vg46d\"" Sep 15 17:34:25.662946 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.662929 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 15 17:34:25.662996 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.662944 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:34:25.663726 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.663705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.663820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.663800 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 15 17:34:25.663884 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.663868 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 15 17:34:25.664038 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.663808 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t6wq4\"" Sep 15 17:34:25.664166 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.664147 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:34:25.664282 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.664264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 15 17:34:25.665606 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.665444 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 15 17:34:25.665811 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.665747 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 17:34:25.665811 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.665754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 17:34:25.666893 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.666875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rrbvm\"" Sep 15 17:34:25.666975 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.666959 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 15 17:34:25.667974 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.667958 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 15 17:34:25.668355 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.668334 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 15 17:34:25.668461 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.668371 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 15 17:34:25.668461 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.668456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2l8wd\"" Sep 15 17:34:25.674379 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.674357 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 15 17:34:25.674721 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.674703 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v"] Sep 15 17:34:25.675437 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.675419 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 15 17:34:25.675691 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.675654 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8"] Sep 15 17:34:25.676343 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.676324 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-n9bgp"] Sep 15 17:34:25.691898 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.691879 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd67bbd6-l94kl"] Sep 15 17:34:25.699946 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.699929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-registry-certificates\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700033 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.699954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43c867b7-6b7a-4b02-ae12-705bb1e6b049-trusted-ca\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.700033 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.699980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47jpg\" (UniqueName: \"kubernetes.io/projected/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-kube-api-access-47jpg\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.700033 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:25.700166 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25d580dd-2d6d-493a-8598-db6f07f14c23-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.700166 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-bound-sa-token\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700250 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-stats-auth\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.700302 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-image-registry-private-configuration\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700302 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700281 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkgr\" (UniqueName: \"kubernetes.io/projected/43c867b7-6b7a-4b02-ae12-705bb1e6b049-kube-api-access-xxkgr\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.700406 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmk5s\" (UniqueName: \"kubernetes.io/projected/0636ab78-d369-47b3-aab8-31d770d733a0-kube-api-access-xmk5s\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:25.700406 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015e2d9c-4c93-4549-b206-126adce8886c-ca-trust-extracted\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700406 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.700406 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43c867b7-6b7a-4b02-ae12-705bb1e6b049-serving-cert\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.700406 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-installation-pull-secrets\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700632 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.700632 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c867b7-6b7a-4b02-ae12-705bb1e6b049-config\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.700632 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.700502 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:34:25.700632 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-default-certificate\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.700632 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.700562 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:26.20054472 +0000 UTC m=+233.958656570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : secret "router-metrics-certs-default" not found Sep 15 17:34:25.700632 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-trusted-ca\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700632 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpcbh\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-kube-api-access-hpcbh\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700911 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.700911 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl94c\" (UniqueName: \"kubernetes.io/projected/25d580dd-2d6d-493a-8598-db6f07f14c23-kube-api-access-wl94c\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.700911 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.700745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.700911 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.700828 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:26.200807079 +0000 UTC m=+233.958918932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : configmap references non-existent config key: service-ca.crt Sep 15 17:34:25.702637 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.702613 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-stats-auth\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.702742 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.702649 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-default-certificate\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.706841 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.706821 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47jpg\" (UniqueName: \"kubernetes.io/projected/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-kube-api-access-47jpg\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:25.801208 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-trusted-ca\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.801372 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpcbh\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-kube-api-access-hpcbh\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.801372 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl94c\" (UniqueName: \"kubernetes.io/projected/25d580dd-2d6d-493a-8598-db6f07f14c23-kube-api-access-wl94c\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.801372 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.801372 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-registry-certificates\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.801372 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.801359 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:34:25.801588 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.801377 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd67bbd6-l94kl: secret "image-registry-tls" not found Sep 15 17:34:25.801588 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.801440 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls podName:015e2d9c-4c93-4549-b206-126adce8886c nodeName:}" failed. No retries permitted until 2026-09-15 17:34:26.301421875 +0000 UTC m=+234.059533729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls") pod "image-registry-6ddd67bbd6-l94kl" (UID: "015e2d9c-4c93-4549-b206-126adce8886c") : secret "image-registry-tls" not found Sep 15 17:34:25.801588 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43c867b7-6b7a-4b02-ae12-705bb1e6b049-trusted-ca\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.801588 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:25.801588 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25d580dd-2d6d-493a-8598-db6f07f14c23-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.801806 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.801691 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:34:25.801806 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-bound-sa-token\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.801806 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.801754 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls podName:0636ab78-d369-47b3-aab8-31d770d733a0 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:26.301735791 +0000 UTC m=+234.059847658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ddp8v" (UID: "0636ab78-d369-47b3-aab8-31d770d733a0") : secret "samples-operator-tls" not found Sep 15 17:34:25.801806 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-image-registry-private-configuration\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.801955 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkgr\" (UniqueName: \"kubernetes.io/projected/43c867b7-6b7a-4b02-ae12-705bb1e6b049-kube-api-access-xxkgr\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.801955 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmk5s\" (UniqueName: \"kubernetes.io/projected/0636ab78-d369-47b3-aab8-31d770d733a0-kube-api-access-xmk5s\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:25.801955 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015e2d9c-4c93-4549-b206-126adce8886c-ca-trust-extracted\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.801955 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.801955 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43c867b7-6b7a-4b02-ae12-705bb1e6b049-serving-cert\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.802158 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-installation-pull-secrets\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.802158 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.802029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c867b7-6b7a-4b02-ae12-705bb1e6b049-config\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.802158 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.801889 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-registry-certificates\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.802326 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.802301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25d580dd-2d6d-493a-8598-db6f07f14c23-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.802409 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.802298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-trusted-ca\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.802409 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.802400 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43c867b7-6b7a-4b02-ae12-705bb1e6b049-trusted-ca\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.802515 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.802405 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:25.802515 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:25.802480 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls podName:25d580dd-2d6d-493a-8598-db6f07f14c23 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:26.302463671 +0000 UTC m=+234.060575524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-267q8" (UID: "25d580dd-2d6d-493a-8598-db6f07f14c23") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:25.802621 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.802570 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015e2d9c-4c93-4549-b206-126adce8886c-ca-trust-extracted\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.802686 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.802670 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c867b7-6b7a-4b02-ae12-705bb1e6b049-config\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.804464 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.804442 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-image-registry-private-configuration\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.804549 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.804481 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-installation-pull-secrets\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.804549 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.804524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43c867b7-6b7a-4b02-ae12-705bb1e6b049-serving-cert\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.810186 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.809879 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl94c\" (UniqueName: \"kubernetes.io/projected/25d580dd-2d6d-493a-8598-db6f07f14c23-kube-api-access-wl94c\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:25.810491 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.810470 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-bound-sa-token\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.810734 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.810710 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpcbh\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-kube-api-access-hpcbh\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:25.810734 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.810730 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkgr\" (UniqueName: \"kubernetes.io/projected/43c867b7-6b7a-4b02-ae12-705bb1e6b049-kube-api-access-xxkgr\") pod \"console-operator-696884fb9c-n9bgp\" (UID: \"43c867b7-6b7a-4b02-ae12-705bb1e6b049\") " pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:25.811059 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.811041 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmk5s\" (UniqueName: \"kubernetes.io/projected/0636ab78-d369-47b3-aab8-31d770d733a0-kube-api-access-xmk5s\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:25.969215 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:25.969180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:26.204571 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:26.204480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:26.204714 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:26.204585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:26.204714 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.204658 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:27.204640026 +0000 UTC m=+234.962751879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : configmap references non-existent config key: service-ca.crt Sep 15 17:34:26.204714 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.204681 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:34:26.204837 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.204719 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:27.204707479 +0000 UTC m=+234.962819328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : secret "router-metrics-certs-default" not found Sep 15 17:34:26.233782 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:26.233756 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-n9bgp"] Sep 15 17:34:26.236370 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:34:26.236348 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c867b7_6b7a_4b02_ae12_705bb1e6b049.slice/crio-b0f5ed06292ea41b386621db6e0b4cf41d39e7346acf00f34266720c9c7bf14d WatchSource:0}: Error finding container b0f5ed06292ea41b386621db6e0b4cf41d39e7346acf00f34266720c9c7bf14d: Status 404 returned error can't find the container with id b0f5ed06292ea41b386621db6e0b4cf41d39e7346acf00f34266720c9c7bf14d Sep 15 17:34:26.305468 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:26.305444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:26.305558 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:26.305476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:26.305558 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:26.305529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:26.305628 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.305594 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:34:26.305628 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.305612 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd67bbd6-l94kl: secret "image-registry-tls" not found Sep 15 17:34:26.305688 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.305641 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:26.305688 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.305658 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:34:26.305688 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.305669 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls podName:015e2d9c-4c93-4549-b206-126adce8886c nodeName:}" failed. No retries permitted until 2026-09-15 17:34:27.305652797 +0000 UTC m=+235.063764662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls") pod "image-registry-6ddd67bbd6-l94kl" (UID: "015e2d9c-4c93-4549-b206-126adce8886c") : secret "image-registry-tls" not found Sep 15 17:34:26.305688 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.305685 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls podName:25d580dd-2d6d-493a-8598-db6f07f14c23 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:27.305677954 +0000 UTC m=+235.063789803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-267q8" (UID: "25d580dd-2d6d-493a-8598-db6f07f14c23") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:26.305815 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:26.305706 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls podName:0636ab78-d369-47b3-aab8-31d770d733a0 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:27.305691171 +0000 UTC m=+235.063803020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ddp8v" (UID: "0636ab78-d369-47b3-aab8-31d770d733a0") : secret "samples-operator-tls" not found Sep 15 17:34:26.388902 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:26.388875 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" event={"ID":"43c867b7-6b7a-4b02-ae12-705bb1e6b049","Type":"ContainerStarted","Data":"b0f5ed06292ea41b386621db6e0b4cf41d39e7346acf00f34266720c9c7bf14d"} Sep 15 17:34:27.213049 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:27.213011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:27.213481 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:27.213064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:27.213481 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.213197 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:34:27.213481 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.213224 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:29.213205679 +0000 UTC m=+236.971317528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : configmap references non-existent config key: service-ca.crt Sep 15 17:34:27.213481 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.213262 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:29.213245244 +0000 UTC m=+236.971357099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : secret "router-metrics-certs-default" not found Sep 15 17:34:27.313546 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:27.313511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:27.313546 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:27.313551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:27.313788 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:27.313604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:27.313788 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.313678 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:34:27.313788 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.313702 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd67bbd6-l94kl: secret "image-registry-tls" not found Sep 15 17:34:27.313788 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.313710 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:27.313788 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.313756 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls podName:015e2d9c-4c93-4549-b206-126adce8886c nodeName:}" failed. No retries permitted until 2026-09-15 17:34:29.313741615 +0000 UTC m=+237.071853467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls") pod "image-registry-6ddd67bbd6-l94kl" (UID: "015e2d9c-4c93-4549-b206-126adce8886c") : secret "image-registry-tls" not found Sep 15 17:34:27.313788 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.313777 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls podName:25d580dd-2d6d-493a-8598-db6f07f14c23 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:29.313761532 +0000 UTC m=+237.071873388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-267q8" (UID: "25d580dd-2d6d-493a-8598-db6f07f14c23") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:27.313788 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.313712 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:34:27.314087 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:27.313810 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls podName:0636ab78-d369-47b3-aab8-31d770d733a0 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:29.313801465 +0000 UTC m=+237.071913317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ddp8v" (UID: "0636ab78-d369-47b3-aab8-31d770d733a0") : secret "samples-operator-tls" not found Sep 15 17:34:28.396700 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:28.396618 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/0.log" Sep 15 17:34:28.396700 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:28.396656 2562 generic.go:356] "Generic (PLEG): container finished" podID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" containerID="c893fbea586b3257038933903faf2da2b28d36f98259694c3bbadb769becb0f0" exitCode=255 Sep 15 17:34:28.397170 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:28.396713 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" event={"ID":"43c867b7-6b7a-4b02-ae12-705bb1e6b049","Type":"ContainerDied","Data":"c893fbea586b3257038933903faf2da2b28d36f98259694c3bbadb769becb0f0"} Sep 15 17:34:28.397170 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:28.396936 2562 scope.go:117] "RemoveContainer" containerID="c893fbea586b3257038933903faf2da2b28d36f98259694c3bbadb769becb0f0" Sep 15 17:34:29.230551 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.230493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:29.230551 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.230563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:29.230795 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.230661 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:34:29.230795 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.230688 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:33.23066838 +0000 UTC m=+240.988780230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : configmap references non-existent config key: service-ca.crt Sep 15 17:34:29.230795 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.230711 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:33.230699949 +0000 UTC m=+240.988811804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : secret "router-metrics-certs-default" not found Sep 15 17:34:29.331309 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.331268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:29.331309 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.331313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:29.331555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.331363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:29.331555 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.331434 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:34:29.331555 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.331457 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd67bbd6-l94kl: secret "image-registry-tls" not found Sep 15 17:34:29.331555 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.331459 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:29.331555 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.331472 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:34:29.331555 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.331527 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls podName:015e2d9c-4c93-4549-b206-126adce8886c nodeName:}" failed. No retries permitted until 2026-09-15 17:34:33.331505738 +0000 UTC m=+241.089617589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls") pod "image-registry-6ddd67bbd6-l94kl" (UID: "015e2d9c-4c93-4549-b206-126adce8886c") : secret "image-registry-tls" not found Sep 15 17:34:29.331555 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.331550 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls podName:25d580dd-2d6d-493a-8598-db6f07f14c23 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:33.331540134 +0000 UTC m=+241.089651991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-267q8" (UID: "25d580dd-2d6d-493a-8598-db6f07f14c23") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:29.331776 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.331565 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls podName:0636ab78-d369-47b3-aab8-31d770d733a0 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:33.331556911 +0000 UTC m=+241.089668768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ddp8v" (UID: "0636ab78-d369-47b3-aab8-31d770d733a0") : secret "samples-operator-tls" not found Sep 15 17:34:29.400724 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.400698 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/1.log" Sep 15 17:34:29.401180 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.401166 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/0.log" Sep 15 17:34:29.401236 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.401199 2562 generic.go:356] "Generic (PLEG): container finished" podID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" containerID="d8f073e67940ff5eed6dac667898dea23654fbd5e825f914168edf74286dc455" exitCode=255 Sep 15 17:34:29.401271 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.401234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" event={"ID":"43c867b7-6b7a-4b02-ae12-705bb1e6b049","Type":"ContainerDied","Data":"d8f073e67940ff5eed6dac667898dea23654fbd5e825f914168edf74286dc455"} Sep 15 17:34:29.401305 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.401295 2562 scope.go:117] "RemoveContainer" containerID="c893fbea586b3257038933903faf2da2b28d36f98259694c3bbadb769becb0f0" Sep 15 17:34:29.401484 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:29.401467 2562 scope.go:117] "RemoveContainer" containerID="d8f073e67940ff5eed6dac667898dea23654fbd5e825f914168edf74286dc455" Sep 15 17:34:29.401683 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:29.401664 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-n9bgp_openshift-console-operator(43c867b7-6b7a-4b02-ae12-705bb1e6b049)\"" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" podUID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" Sep 15 17:34:30.406095 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:30.406053 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/1.log" Sep 15 17:34:30.406563 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:30.406458 2562 scope.go:117] "RemoveContainer" containerID="d8f073e67940ff5eed6dac667898dea23654fbd5e825f914168edf74286dc455" Sep 15 17:34:30.406676 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:30.406654 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-n9bgp_openshift-console-operator(43c867b7-6b7a-4b02-ae12-705bb1e6b049)\"" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" podUID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" Sep 15 17:34:31.007456 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.007423 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jgdc8"] Sep 15 17:34:31.011453 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.011339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.013743 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.013717 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 17:34:31.013849 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.013727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qpsk9\"" Sep 15 17:34:31.014814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.014790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 17:34:31.014929 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.014821 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 17:34:31.014929 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.014884 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 17:34:31.024068 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.024046 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jgdc8"] Sep 15 17:34:31.149692 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.149656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee3e237-b41f-4c0b-a770-0c2745f24f18-data-volume\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.149875 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.149727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.149875 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.149769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ee3e237-b41f-4c0b-a770-0c2745f24f18-crio-socket\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.149875 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.149804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbxn2\" (UniqueName: \"kubernetes.io/projected/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-api-access-vbxn2\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.149987 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.149879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.251010 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.250973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.251184 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.251025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ee3e237-b41f-4c0b-a770-0c2745f24f18-crio-socket\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.251184 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.251051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbxn2\" (UniqueName: \"kubernetes.io/projected/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-api-access-vbxn2\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.251184 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.251106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.251184 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.251129 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ee3e237-b41f-4c0b-a770-0c2745f24f18-crio-socket\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.251184 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.251149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee3e237-b41f-4c0b-a770-0c2745f24f18-data-volume\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.251184 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.251167 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:34:31.251413 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.251207 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:34:31.251413 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.251250 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:31.751228213 +0000 UTC m=+239.509340067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : secret "insights-runtime-extractor-tls" not found Sep 15 17:34:31.251413 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.251270 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:31.751260033 +0000 UTC m=+239.509371882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : configmap "kube-rbac-proxy" not found Sep 15 17:34:31.251511 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.251432 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee3e237-b41f-4c0b-a770-0c2745f24f18-data-volume\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.260320 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.260272 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbxn2\" (UniqueName: \"kubernetes.io/projected/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-api-access-vbxn2\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.755053 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.755004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.755428 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.755148 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:34:31.755428 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:31.755163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:31.755428 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.755228 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:32.755208744 +0000 UTC m=+240.513320599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : configmap "kube-rbac-proxy" not found Sep 15 17:34:31.755428 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.755283 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:34:31.755428 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:31.755339 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:32.755326597 +0000 UTC m=+240.513438449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : secret "insights-runtime-extractor-tls" not found Sep 15 17:34:32.764713 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:32.764682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:32.765052 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:32.764751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:32.765052 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:32.764821 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:34:32.765052 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:32.764826 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:34:32.765052 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:32.764868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:34.764855162 +0000 UTC m=+242.522967011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : configmap "kube-rbac-proxy" not found Sep 15 17:34:32.765052 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:32.764879 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:34.764873874 +0000 UTC m=+242.522985723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : secret "insights-runtime-extractor-tls" not found Sep 15 17:34:33.268127 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:33.268097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:33.268286 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:33.268143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:33.268286 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.268165 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:34:33.268286 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.268220 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:41.268205601 +0000 UTC m=+249.026317455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : secret "router-metrics-certs-default" not found Sep 15 17:34:33.268286 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.268254 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle podName:d3fe5ed1-4f96-4764-9360-ff058cbc91b9 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:41.268243061 +0000 UTC m=+249.026354911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle") pod "router-default-6777464cb4-nw5hb" (UID: "d3fe5ed1-4f96-4764-9360-ff058cbc91b9") : configmap references non-existent config key: service-ca.crt Sep 15 17:34:33.369022 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:33.368989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:33.369183 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:33.369104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:33.369183 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:33.369141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:33.369183 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.369149 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:33.369310 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.369209 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls podName:25d580dd-2d6d-493a-8598-db6f07f14c23 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:41.369191555 +0000 UTC m=+249.127303409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-267q8" (UID: "25d580dd-2d6d-493a-8598-db6f07f14c23") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:34:33.369310 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.369245 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:34:33.369310 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.369266 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:34:33.369310 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.369285 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd67bbd6-l94kl: secret "image-registry-tls" not found Sep 15 17:34:33.369310 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.369290 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls podName:0636ab78-d369-47b3-aab8-31d770d733a0 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:41.369278682 +0000 UTC m=+249.127390547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-ddp8v" (UID: "0636ab78-d369-47b3-aab8-31d770d733a0") : secret "samples-operator-tls" not found Sep 15 17:34:33.369472 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:33.369329 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls podName:015e2d9c-4c93-4549-b206-126adce8886c nodeName:}" failed. No retries permitted until 2026-09-15 17:34:41.369316978 +0000 UTC m=+249.127428830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls") pod "image-registry-6ddd67bbd6-l94kl" (UID: "015e2d9c-4c93-4549-b206-126adce8886c") : secret "image-registry-tls" not found Sep 15 17:34:33.779139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:33.779113 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6ftln_0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9/dns-node-resolver/0.log" Sep 15 17:34:34.579149 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:34.579120 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hkrrv_be3e6f01-bb44-4ffc-8bd3-03c965953454/node-ca/0.log" Sep 15 17:34:34.781155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:34.781114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:34.781541 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:34.781255 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:34:34.781541 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:34.781285 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:34.781541 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:34.781314 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:38.781299222 +0000 UTC m=+246.539411070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : secret "insights-runtime-extractor-tls" not found Sep 15 17:34:34.781541 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:34.781336 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:34:34.781541 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:34.781383 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:38.781368892 +0000 UTC m=+246.539480754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : configmap "kube-rbac-proxy" not found Sep 15 17:34:35.579013 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:35.578987 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wszgt_8bd294ad-7258-4423-b335-7bc32eb366ca/serve-healthcheck-canary/0.log" Sep 15 17:34:35.969526 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:35.969497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:35.969879 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:35.969550 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:35.969922 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:35.969896 2562 scope.go:117] "RemoveContainer" containerID="d8f073e67940ff5eed6dac667898dea23654fbd5e825f914168edf74286dc455" Sep 15 17:34:35.970107 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:35.970065 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-n9bgp_openshift-console-operator(43c867b7-6b7a-4b02-ae12-705bb1e6b049)\"" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" podUID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" Sep 15 17:34:38.815310 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:38.815275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:38.815700 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:38.815354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:38.815700 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:38.815430 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:34:38.815700 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:38.815445 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:34:38.815700 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:38.815492 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:46.81547632 +0000 UTC m=+254.573588169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : secret "insights-runtime-extractor-tls" not found Sep 15 17:34:38.815700 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:38.815506 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm podName:8ee3e237-b41f-4c0b-a770-0c2745f24f18 nodeName:}" failed. No retries permitted until 2026-09-15 17:34:46.815499848 +0000 UTC m=+254.573611697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jgdc8" (UID: "8ee3e237-b41f-4c0b-a770-0c2745f24f18") : configmap "kube-rbac-proxy" not found Sep 15 17:34:41.336451 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.336404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:41.336827 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.336533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:41.337044 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.337008 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-service-ca-bundle\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:41.338722 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.338704 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3fe5ed1-4f96-4764-9360-ff058cbc91b9-metrics-certs\") pod \"router-default-6777464cb4-nw5hb\" (UID: \"d3fe5ed1-4f96-4764-9360-ff058cbc91b9\") " pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:41.437315 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.437289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:41.437469 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.437343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:41.437540 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.437512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:41.439572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.439544 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d580dd-2d6d-493a-8598-db6f07f14c23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-267q8\" (UID: \"25d580dd-2d6d-493a-8598-db6f07f14c23\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:41.439572 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.439564 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0636ab78-d369-47b3-aab8-31d770d733a0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-ddp8v\" (UID: \"0636ab78-d369-47b3-aab8-31d770d733a0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:41.439736 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.439716 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"image-registry-6ddd67bbd6-l94kl\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:41.472118 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.472092 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtdl7\"" Sep 15 17:34:41.480178 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.480159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:41.582725 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.582694 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t6wq4\"" Sep 15 17:34:41.588900 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.588851 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rrbvm\"" Sep 15 17:34:41.590737 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.590721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" Sep 15 17:34:41.593977 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.593964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2l8wd\"" Sep 15 17:34:41.597759 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.597737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" Sep 15 17:34:41.602466 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.602445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:41.748199 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.748092 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6777464cb4-nw5hb"] Sep 15 17:34:41.750477 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:34:41.750454 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fe5ed1_4f96_4764_9360_ff058cbc91b9.slice/crio-dd8d273003871f27e12f5981a0616766c4428958a1cbccbeb332a8bd22d03de5 WatchSource:0}: Error finding container dd8d273003871f27e12f5981a0616766c4428958a1cbccbeb332a8bd22d03de5: Status 404 returned error can't find the container with id dd8d273003871f27e12f5981a0616766c4428958a1cbccbeb332a8bd22d03de5 Sep 15 17:34:41.859073 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.859002 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v"] Sep 15 17:34:41.868327 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.868186 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8"] Sep 15 17:34:41.875993 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:34:41.875964 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d580dd_2d6d_493a_8598_db6f07f14c23.slice/crio-b5915a77f25f7bdeb714657e7d0547cfd173b3189ee7bc1b8ea6c032ddb02828 WatchSource:0}: Error finding container b5915a77f25f7bdeb714657e7d0547cfd173b3189ee7bc1b8ea6c032ddb02828: Status 404 returned error can't find the container with id b5915a77f25f7bdeb714657e7d0547cfd173b3189ee7bc1b8ea6c032ddb02828 Sep 15 17:34:41.881840 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:41.881820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd67bbd6-l94kl"] Sep 15 17:34:41.884908 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:34:41.884888 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015e2d9c_4c93_4549_b206_126adce8886c.slice/crio-9a28301ef989a6c882bc731e2df929183607ae58ef2bae1d38da0310e6fd354d WatchSource:0}: Error finding container 9a28301ef989a6c882bc731e2df929183607ae58ef2bae1d38da0310e6fd354d: Status 404 returned error can't find the container with id 9a28301ef989a6c882bc731e2df929183607ae58ef2bae1d38da0310e6fd354d Sep 15 17:34:42.440960 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.440925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6777464cb4-nw5hb" event={"ID":"d3fe5ed1-4f96-4764-9360-ff058cbc91b9","Type":"ContainerStarted","Data":"1528f327df2cc96b67e149d1f407981e1a04ada7136b88451c89b050e768a734"} Sep 15 17:34:42.441429 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.440979 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6777464cb4-nw5hb" event={"ID":"d3fe5ed1-4f96-4764-9360-ff058cbc91b9","Type":"ContainerStarted","Data":"dd8d273003871f27e12f5981a0616766c4428958a1cbccbeb332a8bd22d03de5"} Sep 15 17:34:42.442433 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.442410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" event={"ID":"015e2d9c-4c93-4549-b206-126adce8886c","Type":"ContainerStarted","Data":"e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5"} Sep 15 17:34:42.442520 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.442449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" event={"ID":"015e2d9c-4c93-4549-b206-126adce8886c","Type":"ContainerStarted","Data":"9a28301ef989a6c882bc731e2df929183607ae58ef2bae1d38da0310e6fd354d"} Sep 15 17:34:42.442520 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.442487 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:34:42.443526 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.443507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" event={"ID":"25d580dd-2d6d-493a-8598-db6f07f14c23","Type":"ContainerStarted","Data":"b5915a77f25f7bdeb714657e7d0547cfd173b3189ee7bc1b8ea6c032ddb02828"} Sep 15 17:34:42.444546 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.444521 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" event={"ID":"0636ab78-d369-47b3-aab8-31d770d733a0","Type":"ContainerStarted","Data":"17b449276464020ee20e291c3327778aa45166313801c8423ceb86bf14d0bec0"} Sep 15 17:34:42.459484 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.459448 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6777464cb4-nw5hb" podStartSLOduration=17.459435733 podStartE2EDuration="17.459435733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:42.458617725 +0000 UTC m=+250.216729628" watchObservedRunningTime="2026-09-15 17:34:42.459435733 +0000 UTC m=+250.217547603" Sep 15 17:34:42.474708 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.474672 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" podStartSLOduration=17.474658652 podStartE2EDuration="17.474658652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:42.474324028 +0000 UTC m=+250.232435901" watchObservedRunningTime="2026-09-15 17:34:42.474658652 +0000 UTC m=+250.232770516" Sep 15 17:34:42.480800 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.480779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:42.483657 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:42.483637 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:43.448401 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:43.448367 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:43.449859 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:43.449837 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6777464cb4-nw5hb" Sep 15 17:34:43.555674 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:43.555509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:34:43.557982 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:43.557954 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94489f1-50e8-4935-a293-149b65aa4c7f-metrics-certs\") pod \"network-metrics-daemon-b9wkp\" (UID: \"d94489f1-50e8-4935-a293-149b65aa4c7f\") " pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:34:43.839912 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:43.839874 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xh7q9\"" Sep 15 17:34:43.848814 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:43.848782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9wkp" Sep 15 17:34:44.453802 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:44.453721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" event={"ID":"25d580dd-2d6d-493a-8598-db6f07f14c23","Type":"ContainerStarted","Data":"6a87550f3b01d3b3dd98ee39d983fe5fc864306ca4d4ae4f333808d2abd1616a"} Sep 15 17:34:44.457342 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:44.457216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" event={"ID":"0636ab78-d369-47b3-aab8-31d770d733a0","Type":"ContainerStarted","Data":"2218c2e539749ba57bd67bfa346fb89b422df677877490924f5a7adeb51a6405"} Sep 15 17:34:44.457342 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:44.457267 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" event={"ID":"0636ab78-d369-47b3-aab8-31d770d733a0","Type":"ContainerStarted","Data":"b1c8dc75a9d69f62ada6bda1cb413a770fedfbc195b917a8b0073dabed4ecb3d"} Sep 15 17:34:44.457342 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:44.457297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9wkp"] Sep 15 17:34:44.461394 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:34:44.461362 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94489f1_50e8_4935_a293_149b65aa4c7f.slice/crio-a9ac8773243fcbd3ceadedb11810a232d02e8363218a0c4596b0a35b77990ee5 WatchSource:0}: Error finding container a9ac8773243fcbd3ceadedb11810a232d02e8363218a0c4596b0a35b77990ee5: Status 404 returned error can't find the container with id a9ac8773243fcbd3ceadedb11810a232d02e8363218a0c4596b0a35b77990ee5 Sep 15 17:34:44.470139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:44.470101 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-267q8" podStartSLOduration=17.151227308 podStartE2EDuration="19.470062717s" totalImagesPullingTime="2.318835409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:44.469194141 +0000 UTC m=+252.227306015" watchObservedRunningTime="2026-09-15 17:34:44.470062717 +0000 UTC m=+252.228174601" Sep 15 17:34:44.490259 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:44.490207 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-ddp8v" podStartSLOduration=17.199687207 podStartE2EDuration="19.490192842s" totalImagesPullingTime="2.290505635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:44.489466463 +0000 UTC m=+252.247578335" watchObservedRunningTime="2026-09-15 17:34:44.490192842 +0000 UTC m=+252.248304713" Sep 15 17:34:45.461631 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:45.461591 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9wkp" event={"ID":"d94489f1-50e8-4935-a293-149b65aa4c7f","Type":"ContainerStarted","Data":"a9ac8773243fcbd3ceadedb11810a232d02e8363218a0c4596b0a35b77990ee5"} Sep 15 17:34:46.466475 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.466439 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9wkp" event={"ID":"d94489f1-50e8-4935-a293-149b65aa4c7f","Type":"ContainerStarted","Data":"79a19b0af5e1d44b2b54cb5de2300bb79ac23ac5872bb1f1967deca023493799"} Sep 15 17:34:46.466825 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.466526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9wkp" event={"ID":"d94489f1-50e8-4935-a293-149b65aa4c7f","Type":"ContainerStarted","Data":"2b5f95d8469ebf42e644d9e49b8c4f5962a31bffb244d3073e09d461b3f688a2"} Sep 15 17:34:46.482461 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.482416 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b9wkp" podStartSLOduration=253.294705405 podStartE2EDuration="4m14.482402578s" totalImagesPullingTime="1.187697173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:46.480703486 +0000 UTC m=+254.238815368" watchObservedRunningTime="2026-09-15 17:34:46.482402578 +0000 UTC m=+254.240514658" Sep 15 17:34:46.883696 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.883659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:46.883837 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.883737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:46.884324 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.884305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee3e237-b41f-4c0b-a770-0c2745f24f18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:46.886111 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.886087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee3e237-b41f-4c0b-a770-0c2745f24f18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgdc8\" (UID: \"8ee3e237-b41f-4c0b-a770-0c2745f24f18\") " pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:46.922560 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.922535 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qpsk9\"" Sep 15 17:34:46.930574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:46.930548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jgdc8" Sep 15 17:34:47.199040 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:47.198955 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jgdc8"] Sep 15 17:34:47.201655 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:34:47.201615 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee3e237_b41f_4c0b_a770_0c2745f24f18.slice/crio-26cc27ae0ad900d846623d59dc6add1b54a0a9bd464dd4df262084b01522321f WatchSource:0}: Error finding container 26cc27ae0ad900d846623d59dc6add1b54a0a9bd464dd4df262084b01522321f: Status 404 returned error can't find the container with id 26cc27ae0ad900d846623d59dc6add1b54a0a9bd464dd4df262084b01522321f Sep 15 17:34:47.471522 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:47.471487 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgdc8" event={"ID":"8ee3e237-b41f-4c0b-a770-0c2745f24f18","Type":"ContainerStarted","Data":"1495f016c127ef0bc26bc839e0382205d0b9c9e990b2e18a9be9f13d1c229690"} Sep 15 17:34:47.471885 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:47.471548 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgdc8" event={"ID":"8ee3e237-b41f-4c0b-a770-0c2745f24f18","Type":"ContainerStarted","Data":"26cc27ae0ad900d846623d59dc6add1b54a0a9bd464dd4df262084b01522321f"} Sep 15 17:34:48.476307 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:48.476278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgdc8" event={"ID":"8ee3e237-b41f-4c0b-a770-0c2745f24f18","Type":"ContainerStarted","Data":"cb9ac61442c6bc3cecd37607c13972f51104ff19cb8304982ca8245af58ff1f8"} Sep 15 17:34:48.737281 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:48.737212 2562 scope.go:117] "RemoveContainer" containerID="d8f073e67940ff5eed6dac667898dea23654fbd5e825f914168edf74286dc455" Sep 15 17:34:49.482029 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:49.481997 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:34:49.482484 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:49.482468 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/1.log" Sep 15 17:34:49.482569 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:49.482508 2562 generic.go:356] "Generic (PLEG): container finished" podID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" containerID="76410eb25be6f850194901212e8faca09545fb247ea728db96ea13f53959173b" exitCode=255 Sep 15 17:34:49.482621 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:49.482578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" event={"ID":"43c867b7-6b7a-4b02-ae12-705bb1e6b049","Type":"ContainerDied","Data":"76410eb25be6f850194901212e8faca09545fb247ea728db96ea13f53959173b"} Sep 15 17:34:49.482683 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:49.482649 2562 scope.go:117] "RemoveContainer" containerID="d8f073e67940ff5eed6dac667898dea23654fbd5e825f914168edf74286dc455" Sep 15 17:34:49.483027 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:49.483003 2562 scope.go:117] "RemoveContainer" containerID="76410eb25be6f850194901212e8faca09545fb247ea728db96ea13f53959173b" Sep 15 17:34:49.483247 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:49.483222 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-n9bgp_openshift-console-operator(43c867b7-6b7a-4b02-ae12-705bb1e6b049)\"" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" podUID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" Sep 15 17:34:50.487177 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:50.487150 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:34:50.489066 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:50.489043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgdc8" event={"ID":"8ee3e237-b41f-4c0b-a770-0c2745f24f18","Type":"ContainerStarted","Data":"f4c168e492df86c0caf5583eb9385312b31aaa3b8c58a7a9c7be123fa3a5444b"} Sep 15 17:34:50.505729 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:50.505688 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jgdc8" podStartSLOduration=18.15461251 podStartE2EDuration="20.505673602s" totalImagesPullingTime="2.351061092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:34:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:50.504448938 +0000 UTC m=+258.262560849" watchObservedRunningTime="2026-09-15 17:34:50.505673602 +0000 UTC m=+258.263785473" Sep 15 17:34:55.783842 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:55.783810 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddd67bbd6-l94kl"] Sep 15 17:34:55.969299 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:55.969264 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:55.969454 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:55.969310 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:34:55.969605 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:55.969586 2562 scope.go:117] "RemoveContainer" containerID="76410eb25be6f850194901212e8faca09545fb247ea728db96ea13f53959173b" Sep 15 17:34:55.969742 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:55.969726 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-n9bgp_openshift-console-operator(43c867b7-6b7a-4b02-ae12-705bb1e6b049)\"" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" podUID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" Sep 15 17:34:59.759097 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.759058 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-64n4z"] Sep 15 17:34:59.761329 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.761314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.765224 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.765201 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 17:34:59.765224 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.765224 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 15 17:34:59.765404 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.765205 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 15 17:34:59.765404 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.765269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9q6kp\"" Sep 15 17:34:59.770884 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.770862 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-64n4z"] Sep 15 17:34:59.880552 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.880527 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.880652 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.880564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.880652 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.880596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.880652 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.880641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds8rq\" (UniqueName: \"kubernetes.io/projected/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-kube-api-access-ds8rq\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.981408 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.981374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.981545 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.981430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.981545 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:59.981527 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 15 17:34:59.981671 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:34:59.981598 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-tls podName:71c575f1-dcf0-4f14-9b5a-6998a0eacfdd nodeName:}" failed. No retries permitted until 2026-09-15 17:35:00.481579609 +0000 UTC m=+268.239691463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-64n4z" (UID: "71c575f1-dcf0-4f14-9b5a-6998a0eacfdd") : secret "prometheus-operator-tls" not found Sep 15 17:34:59.981671 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.981600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds8rq\" (UniqueName: \"kubernetes.io/projected/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-kube-api-access-ds8rq\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.981791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.981687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.982144 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.982125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.984034 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.984017 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:34:59.991875 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:34:59.991853 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds8rq\" (UniqueName: \"kubernetes.io/projected/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-kube-api-access-ds8rq\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:35:00.486644 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:00.486603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:35:00.488987 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:00.488964 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/71c575f1-dcf0-4f14-9b5a-6998a0eacfdd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-64n4z\" (UID: \"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:35:00.671139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:00.671104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" Sep 15 17:35:00.934506 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:00.934427 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-64n4z"] Sep 15 17:35:00.936861 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:35:00.936841 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c575f1_dcf0_4f14_9b5a_6998a0eacfdd.slice/crio-2d76f99cf58a7347c754e6fbf3b138d2a5f1e36d75b25fb605818c3585a9e3fe WatchSource:0}: Error finding container 2d76f99cf58a7347c754e6fbf3b138d2a5f1e36d75b25fb605818c3585a9e3fe: Status 404 returned error can't find the container with id 2d76f99cf58a7347c754e6fbf3b138d2a5f1e36d75b25fb605818c3585a9e3fe Sep 15 17:35:01.524833 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:01.524781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" event={"ID":"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd","Type":"ContainerStarted","Data":"2d76f99cf58a7347c754e6fbf3b138d2a5f1e36d75b25fb605818c3585a9e3fe"} Sep 15 17:35:03.532912 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:03.532877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" event={"ID":"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd","Type":"ContainerStarted","Data":"991e349663d6ba9e4573174d6b8a5d319f9ffc3d8c62a6351aa2e3b7007ca722"} Sep 15 17:35:03.533351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:03.532927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" event={"ID":"71c575f1-dcf0-4f14-9b5a-6998a0eacfdd","Type":"ContainerStarted","Data":"97e7e189dcadac6ecc702f3b802384d441019240c667235b30bdce9d1ec1c1a7"} Sep 15 17:35:03.548806 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:03.548760 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-64n4z" podStartSLOduration=2.752381667 podStartE2EDuration="4.548744344s" totalImagesPullingTime="1.796362677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:35:03.547208373 +0000 UTC m=+271.305320244" watchObservedRunningTime="2026-09-15 17:35:03.548744344 +0000 UTC m=+271.306856214" Sep 15 17:35:05.118908 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.118871 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ffg67"] Sep 15 17:35:05.122320 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.122304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.125815 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.125791 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 17:35:05.125815 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.125802 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-862vr\"" Sep 15 17:35:05.126142 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.126122 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 17:35:05.126304 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.126285 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 17:35:05.219664 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-sys\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.219664 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.219901 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.219901 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4362d499-4a1e-4191-89c4-b499326d0a75-metrics-client-ca\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.219901 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-wtmp\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.219901 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-textfile\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.219901 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-root\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.220141 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-tls\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.220141 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.219988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49r6\" (UniqueName: \"kubernetes.io/projected/4362d499-4a1e-4191-89c4-b499326d0a75-kube-api-access-x49r6\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320646 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49r6\" (UniqueName: \"kubernetes.io/projected/4362d499-4a1e-4191-89c4-b499326d0a75-kube-api-access-x49r6\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320646 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-sys\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4362d499-4a1e-4191-89c4-b499326d0a75-metrics-client-ca\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-wtmp\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-sys\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-textfile\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-root\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.320899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-tls\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.321298 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-wtmp\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.321298 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.320985 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4362d499-4a1e-4191-89c4-b499326d0a75-root\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.321298 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.321152 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-textfile\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.321470 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.321450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4362d499-4a1e-4191-89c4-b499326d0a75-metrics-client-ca\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.321520 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.321450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-accelerators-collector-config\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.323121 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.323103 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-tls\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.323210 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.323167 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4362d499-4a1e-4191-89c4-b499326d0a75-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.329699 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.329676 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49r6\" (UniqueName: \"kubernetes.io/projected/4362d499-4a1e-4191-89c4-b499326d0a75-kube-api-access-x49r6\") pod \"node-exporter-ffg67\" (UID: \"4362d499-4a1e-4191-89c4-b499326d0a75\") " pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.431248 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.431174 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ffg67" Sep 15 17:35:05.442267 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:35:05.442239 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4362d499_4a1e_4191_89c4_b499326d0a75.slice/crio-2fe326d15316ab13bdbbffcd7d91da1bff0cca7d4d3a699d65c15b753454d6a4 WatchSource:0}: Error finding container 2fe326d15316ab13bdbbffcd7d91da1bff0cca7d4d3a699d65c15b753454d6a4: Status 404 returned error can't find the container with id 2fe326d15316ab13bdbbffcd7d91da1bff0cca7d4d3a699d65c15b753454d6a4 Sep 15 17:35:05.540694 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.540664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffg67" event={"ID":"4362d499-4a1e-4191-89c4-b499326d0a75","Type":"ContainerStarted","Data":"2fe326d15316ab13bdbbffcd7d91da1bff0cca7d4d3a699d65c15b753454d6a4"} Sep 15 17:35:05.789483 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.789449 2562 patch_prober.go:28] interesting pod/image-registry-6ddd67bbd6-l94kl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 15 17:35:05.789651 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:05.789501 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" podUID="015e2d9c-4c93-4549-b206-126adce8886c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 17:35:07.549070 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:07.549034 2562 generic.go:356] "Generic (PLEG): container finished" podID="4362d499-4a1e-4191-89c4-b499326d0a75" containerID="cbabf02079fb0ba2d4367b94f89d0963cd41ddf105204fbe5fa305658ce5f020" exitCode=0 Sep 15 17:35:07.549556 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:07.549128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffg67" event={"ID":"4362d499-4a1e-4191-89c4-b499326d0a75","Type":"ContainerDied","Data":"cbabf02079fb0ba2d4367b94f89d0963cd41ddf105204fbe5fa305658ce5f020"} Sep 15 17:35:07.737011 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:07.736981 2562 scope.go:117] "RemoveContainer" containerID="76410eb25be6f850194901212e8faca09545fb247ea728db96ea13f53959173b" Sep 15 17:35:07.737250 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:35:07.737217 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-n9bgp_openshift-console-operator(43c867b7-6b7a-4b02-ae12-705bb1e6b049)\"" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" podUID="43c867b7-6b7a-4b02-ae12-705bb1e6b049" Sep 15 17:35:08.554176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:08.554141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffg67" event={"ID":"4362d499-4a1e-4191-89c4-b499326d0a75","Type":"ContainerStarted","Data":"f5ae575e901047ef2c578e578dd666e169bfbce403246abd2bb7bcc85f4c99df"} Sep 15 17:35:08.554650 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:08.554191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ffg67" event={"ID":"4362d499-4a1e-4191-89c4-b499326d0a75","Type":"ContainerStarted","Data":"541ac70e4abc3d7a8e212532fc56fe387b8d8247e74fd267c950569c933414c1"} Sep 15 17:35:08.571722 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:08.571673 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ffg67" podStartSLOduration=2.381418226 podStartE2EDuration="3.571658327s" totalImagesPullingTime="1.129924733s" totalInitContainerRuntime="60.315368ms" isStatefulPod=true podCreationTimestamp="2026-09-15 17:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:35:08.570757116 +0000 UTC m=+276.328868991" watchObservedRunningTime="2026-09-15 17:35:08.571658327 +0000 UTC m=+276.329770198" Sep 15 17:35:09.871931 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:09.871900 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79"] Sep 15 17:35:09.875061 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:09.875045 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:09.877357 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:09.877337 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 15 17:35:09.877430 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:09.877390 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tgxfb\"" Sep 15 17:35:09.883040 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:09.882993 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79"] Sep 15 17:35:09.957794 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:09.957764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfwnz\" (UniqueName: \"kubernetes.io/projected/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-kube-api-access-wfwnz\") pod \"monitoring-plugin-5d85778b9d-j8h79\" (UID: \"2175c4dd-1ae1-434d-9b17-126bb3c0e85e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:09.957936 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:09.957824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-j8h79\" (UID: \"2175c4dd-1ae1-434d-9b17-126bb3c0e85e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:10.058404 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:10.058366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfwnz\" (UniqueName: \"kubernetes.io/projected/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-kube-api-access-wfwnz\") pod \"monitoring-plugin-5d85778b9d-j8h79\" (UID: \"2175c4dd-1ae1-434d-9b17-126bb3c0e85e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:10.058530 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:10.058437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-j8h79\" (UID: \"2175c4dd-1ae1-434d-9b17-126bb3c0e85e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:10.058585 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:35:10.058547 2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 15 17:35:10.058617 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:35:10.058609 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-monitoring-plugin-cert podName:2175c4dd-1ae1-434d-9b17-126bb3c0e85e nodeName:}" failed. No retries permitted until 2026-09-15 17:35:10.558590825 +0000 UTC m=+278.316702677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-j8h79" (UID: "2175c4dd-1ae1-434d-9b17-126bb3c0e85e") : secret "monitoring-plugin-cert" not found Sep 15 17:35:10.067209 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:10.067186 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfwnz\" (UniqueName: \"kubernetes.io/projected/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-kube-api-access-wfwnz\") pod \"monitoring-plugin-5d85778b9d-j8h79\" (UID: \"2175c4dd-1ae1-434d-9b17-126bb3c0e85e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:10.563598 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:10.563566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-j8h79\" (UID: \"2175c4dd-1ae1-434d-9b17-126bb3c0e85e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:10.565924 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:10.565896 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2175c4dd-1ae1-434d-9b17-126bb3c0e85e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-j8h79\" (UID: \"2175c4dd-1ae1-434d-9b17-126bb3c0e85e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:10.785282 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:10.785251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:11.052228 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.052191 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79"] Sep 15 17:35:11.055881 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:35:11.055841 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2175c4dd_1ae1_434d_9b17_126bb3c0e85e.slice/crio-d04f425ba888cc5b8f8e83fe40054ec0c49da3d1a3cbeb3d177be9b91c61b41b WatchSource:0}: Error finding container d04f425ba888cc5b8f8e83fe40054ec0c49da3d1a3cbeb3d177be9b91c61b41b: Status 404 returned error can't find the container with id d04f425ba888cc5b8f8e83fe40054ec0c49da3d1a3cbeb3d177be9b91c61b41b Sep 15 17:35:11.288656 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.288618 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:35:11.298006 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.297970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.301280 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.301227 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 17:35:11.301280 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.301273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-918o8nf2ubaee\"" Sep 15 17:35:11.301529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.301508 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 17:35:11.301621 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.301548 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 17:35:11.301621 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.301517 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302221 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-54j5b\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302227 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302338 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 17:35:11.302523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302514 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 17:35:11.302979 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302534 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 17:35:11.302979 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.302522 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 17:35:11.303445 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.303426 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 17:35:11.307062 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.306859 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 17:35:11.307289 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.307268 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:35:11.370001 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.369962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370162 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370162 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370162 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370162 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370467 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370467 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370467 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370640 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lvzj\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-kube-api-access-2lvzj\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370640 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370698 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.370738 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.370698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-config\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471342 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471342 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471593 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471593 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471593 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471593 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471772 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471772 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471772 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471772 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471983 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471983 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471983 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lvzj\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-kube-api-access-2lvzj\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.471983 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.471892 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.473090 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.472650 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.473090 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.472653 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.473992 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.473443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.474261 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.474205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.474456 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.474242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-config\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.474456 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.474424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.474688 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.474649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.474864 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.474815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.475038 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.474994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.475277 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.475192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.475610 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.475579 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.476154 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.476048 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.476664 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.476446 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.476664 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.476618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.477480 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.477242 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.477480 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.477414 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.477480 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.477443 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.477773 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.477727 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.478870 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.478509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.479362 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.479337 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.479650 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.479623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.479965 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.479935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.480070 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.479991 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.481153 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.481131 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-config\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.481395 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.481369 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lvzj\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-kube-api-access-2lvzj\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.481590 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.481573 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.565211 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.565108 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" event={"ID":"2175c4dd-1ae1-434d-9b17-126bb3c0e85e","Type":"ContainerStarted","Data":"d04f425ba888cc5b8f8e83fe40054ec0c49da3d1a3cbeb3d177be9b91c61b41b"} Sep 15 17:35:11.610067 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.610028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:11.895992 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:11.895717 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:35:11.898572 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:35:11.898536 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d06d68_5d74_4538_a229_30c219f999f5.slice/crio-9fe686f1c3356ed05d8d974f9a38ae5fec556d9992a3b6fddf0b0a45b8218b45 WatchSource:0}: Error finding container 9fe686f1c3356ed05d8d974f9a38ae5fec556d9992a3b6fddf0b0a45b8218b45: Status 404 returned error can't find the container with id 9fe686f1c3356ed05d8d974f9a38ae5fec556d9992a3b6fddf0b0a45b8218b45 Sep 15 17:35:12.571104 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:12.571032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" event={"ID":"2175c4dd-1ae1-434d-9b17-126bb3c0e85e","Type":"ContainerStarted","Data":"7600c18066fb2eb5d239e45c949450afc9352de84e24d6acb573e93d6c36d604"} Sep 15 17:35:12.571560 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:12.571537 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:12.572558 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:12.572530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerStarted","Data":"9fe686f1c3356ed05d8d974f9a38ae5fec556d9992a3b6fddf0b0a45b8218b45"} Sep 15 17:35:12.576404 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:12.576379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" Sep 15 17:35:12.586527 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:12.586480 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-j8h79" podStartSLOduration=2.213291936 podStartE2EDuration="3.586461903s" totalImagesPullingTime="1.373169967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:35:12.585767518 +0000 UTC m=+280.343879389" watchObservedRunningTime="2026-09-15 17:35:12.586461903 +0000 UTC m=+280.344573776" Sep 15 17:35:13.577869 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:13.577833 2562 generic.go:356] "Generic (PLEG): container finished" podID="60d06d68-5d74-4538-a229-30c219f999f5" containerID="b199df3ee5e5d9a64f2e4cb22c18cac1d611b279c3cba55dd0f177ad442b2dd4" exitCode=0 Sep 15 17:35:13.578352 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:13.577927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"b199df3ee5e5d9a64f2e4cb22c18cac1d611b279c3cba55dd0f177ad442b2dd4"} Sep 15 17:35:14.206220 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:35:14.206179 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mlfv9" podUID="65bdb16b-3b25-40e1-98a4-c3b408fc4585" Sep 15 17:35:14.581252 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:14.581220 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlfv9" Sep 15 17:35:15.789478 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:15.789446 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:35:17.525398 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:17.525357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:35:17.527828 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:17.527805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bdb16b-3b25-40e1-98a4-c3b408fc4585-metrics-tls\") pod \"dns-default-mlfv9\" (UID: \"65bdb16b-3b25-40e1-98a4-c3b408fc4585\") " pod="openshift-dns/dns-default-mlfv9" Sep 15 17:35:17.584569 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:17.584546 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vrkqb\"" Sep 15 17:35:17.592166 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:17.592137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mlfv9" Sep 15 17:35:17.597707 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:17.597667 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerStarted","Data":"55cbc67c8969e61c796e5eaf8fba5605374e7db84a9b08cd69297f95aba5fd74"} Sep 15 17:35:17.597800 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:17.597747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerStarted","Data":"877cf336d47fe9a4c6a0f9d6afbfbe718b59c7a487138398889192ed2d9caaf5"} Sep 15 17:35:17.870411 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:17.870268 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mlfv9"] Sep 15 17:35:17.872604 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:35:17.872574 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65bdb16b_3b25_40e1_98a4_c3b408fc4585.slice/crio-9199edf730d0bdae08b7cda4b1cf0e807c10666601513ecb23a7b1829b36c195 WatchSource:0}: Error finding container 9199edf730d0bdae08b7cda4b1cf0e807c10666601513ecb23a7b1829b36c195: Status 404 returned error can't find the container with id 9199edf730d0bdae08b7cda4b1cf0e807c10666601513ecb23a7b1829b36c195 Sep 15 17:35:18.602800 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:18.602760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlfv9" event={"ID":"65bdb16b-3b25-40e1-98a4-c3b408fc4585","Type":"ContainerStarted","Data":"9199edf730d0bdae08b7cda4b1cf0e807c10666601513ecb23a7b1829b36c195"} Sep 15 17:35:19.611120 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:19.611015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerStarted","Data":"b8a2f71f3d17e214cdbdb0bd9de239c877aeea23f499e9c3023d51f0b807f423"} Sep 15 17:35:19.611587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:19.611124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerStarted","Data":"9b9f75c1ab62bd7561ad8efc3c647a865dd5ac76b7947bce46d82d57cd2e47fe"} Sep 15 17:35:19.611587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:19.611164 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerStarted","Data":"3154ade5d358938b0074ae33020d276a8b597746cf3ed4c19b8b37a156b7cfda"} Sep 15 17:35:19.611587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:19.611198 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerStarted","Data":"1f453ca1aa962f74a98eb9fc2af589e8c9eaf5802eab9794f877db0b2f2ca741"} Sep 15 17:35:19.638704 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:19.638638 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.182313458 podStartE2EDuration="8.638619917s" totalImagesPullingTime="6.438423278s" totalInitContainerRuntime="17.883181ms" isStatefulPod=false podCreationTimestamp="2026-09-15 17:35:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:35:19.637480936 +0000 UTC m=+287.395592833" watchObservedRunningTime="2026-09-15 17:35:19.638619917 +0000 UTC m=+287.396731831" Sep 15 17:35:20.620663 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:20.620623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlfv9" event={"ID":"65bdb16b-3b25-40e1-98a4-c3b408fc4585","Type":"ContainerStarted","Data":"0769dd9d68571dfd656f4a93594048a9ccdb5bbd7617b55ffa5154a82e5c47c8"} Sep 15 17:35:20.621052 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:20.620982 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mlfv9" Sep 15 17:35:20.621052 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:20.621013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mlfv9" event={"ID":"65bdb16b-3b25-40e1-98a4-c3b408fc4585","Type":"ContainerStarted","Data":"8944390dbff8bdf821758b23363e0d0758e2435f786e61a1eef86706920fa275"} Sep 15 17:35:20.637601 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:20.637559 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mlfv9" podStartSLOduration=251.328185035 podStartE2EDuration="4m13.637546516s" totalImagesPullingTime="2.309361481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:35:20.636667686 +0000 UTC m=+288.394779568" watchObservedRunningTime="2026-09-15 17:35:20.637546516 +0000 UTC m=+288.395658386" Sep 15 17:35:20.737719 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:20.737694 2562 scope.go:117] "RemoveContainer" containerID="76410eb25be6f850194901212e8faca09545fb247ea728db96ea13f53959173b" Sep 15 17:35:20.801709 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:20.801675 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" podUID="015e2d9c-4c93-4549-b206-126adce8886c" containerName="registry" containerID="cri-o://e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5" gracePeriod=30 Sep 15 17:35:21.036056 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.036032 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:35:21.158590 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158552 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-installation-pull-secrets\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.158776 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158606 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-image-registry-private-configuration\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.158776 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158653 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.158776 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158730 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpcbh\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-kube-api-access-hpcbh\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.158953 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158784 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-registry-certificates\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.158953 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158860 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-trusted-ca\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.158953 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158896 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-bound-sa-token\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.158953 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.158927 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015e2d9c-4c93-4549-b206-126adce8886c-ca-trust-extracted\") pod \"015e2d9c-4c93-4549-b206-126adce8886c\" (UID: \"015e2d9c-4c93-4549-b206-126adce8886c\") " Sep 15 17:35:21.163119 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.162997 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:35:21.163856 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.163816 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:35:21.165951 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.165911 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-kube-api-access-hpcbh" (OuterVolumeSpecName: "kube-api-access-hpcbh") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "kube-api-access-hpcbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:35:21.166035 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.165992 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:35:21.166229 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.166201 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:35:21.168961 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.168918 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:35:21.170668 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.170641 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:35:21.171836 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.171810 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/015e2d9c-4c93-4549-b206-126adce8886c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "015e2d9c-4c93-4549-b206-126adce8886c" (UID: "015e2d9c-4c93-4549-b206-126adce8886c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260439 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-image-registry-private-configuration\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260477 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-registry-tls\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260493 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpcbh\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-kube-api-access-hpcbh\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260507 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-registry-certificates\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260521 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/015e2d9c-4c93-4549-b206-126adce8886c-trusted-ca\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260536 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015e2d9c-4c93-4549-b206-126adce8886c-bound-sa-token\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260549 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/015e2d9c-4c93-4549-b206-126adce8886c-ca-trust-extracted\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.260596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.260562 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/015e2d9c-4c93-4549-b206-126adce8886c-installation-pull-secrets\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:35:21.610395 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.610363 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:21.626066 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.626034 2562 generic.go:356] "Generic (PLEG): container finished" podID="015e2d9c-4c93-4549-b206-126adce8886c" containerID="e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5" exitCode=0 Sep 15 17:35:21.626565 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.626105 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" Sep 15 17:35:21.626565 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.626109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" event={"ID":"015e2d9c-4c93-4549-b206-126adce8886c","Type":"ContainerDied","Data":"e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5"} Sep 15 17:35:21.626565 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.626165 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd67bbd6-l94kl" event={"ID":"015e2d9c-4c93-4549-b206-126adce8886c","Type":"ContainerDied","Data":"9a28301ef989a6c882bc731e2df929183607ae58ef2bae1d38da0310e6fd354d"} Sep 15 17:35:21.626565 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.626192 2562 scope.go:117] "RemoveContainer" containerID="e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5" Sep 15 17:35:21.628225 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.628203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:35:21.628402 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.628379 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" event={"ID":"43c867b7-6b7a-4b02-ae12-705bb1e6b049","Type":"ContainerStarted","Data":"2a34feb4d54f9a9e0e296f93bbed8aa6aad81f0c1b90592f18559f87658e38c0"} Sep 15 17:35:21.635375 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.635321 2562 scope.go:117] "RemoveContainer" containerID="e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5" Sep 15 17:35:21.635594 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:35:21.635573 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5\": container with ID starting with e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5 not found: ID does not exist" containerID="e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5" Sep 15 17:35:21.635673 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.635600 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5"} err="failed to get container status \"e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5\": rpc error: code = NotFound desc = could not find container \"e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5\": container with ID starting with e568ea341daf9cae6c2b786855adfcc19a96928421b0567a01c874b994fd44b5 not found: ID does not exist" Sep 15 17:35:21.645822 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.645781 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" podStartSLOduration=54.760370567 podStartE2EDuration="56.645767591s" totalImagesPullingTime="1.885397024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:35:21.644703852 +0000 UTC m=+289.402815724" watchObservedRunningTime="2026-09-15 17:35:21.645767591 +0000 UTC m=+289.403879462" Sep 15 17:35:21.656701 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.656680 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddd67bbd6-l94kl"] Sep 15 17:35:21.660439 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:21.660416 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ddd67bbd6-l94kl"] Sep 15 17:35:22.742202 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:22.742164 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="015e2d9c-4c93-4549-b206-126adce8886c" path="/var/lib/kubelet/pods/015e2d9c-4c93-4549-b206-126adce8886c/volumes" Sep 15 17:35:31.629150 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:31.629118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:35:31.632831 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:31.632808 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-n9bgp" Sep 15 17:35:31.635951 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:31.635930 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mlfv9" Sep 15 17:35:32.636766 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:32.636738 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:35:32.637491 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:32.637473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:35:32.648998 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:35:32.648976 2562 kubelet.go:1648] "Image garbage collection succeeded" Sep 15 17:36:11.610473 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:11.610427 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:11.625872 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:11.625849 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:11.844155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:11.844128 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:29.729027 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.728941 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:36:29.729589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.729318 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="prometheus" containerID="cri-o://877cf336d47fe9a4c6a0f9d6afbfbe718b59c7a487138398889192ed2d9caaf5" gracePeriod=600 Sep 15 17:36:29.729589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.729379 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="thanos-sidecar" containerID="cri-o://1f453ca1aa962f74a98eb9fc2af589e8c9eaf5802eab9794f877db0b2f2ca741" gracePeriod=600 Sep 15 17:36:29.729589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.729488 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="config-reloader" containerID="cri-o://55cbc67c8969e61c796e5eaf8fba5605374e7db84a9b08cd69297f95aba5fd74" gracePeriod=600 Sep 15 17:36:29.729589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.729525 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-web" containerID="cri-o://3154ade5d358938b0074ae33020d276a8b597746cf3ed4c19b8b37a156b7cfda" gracePeriod=600 Sep 15 17:36:29.729788 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.729674 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b8a2f71f3d17e214cdbdb0bd9de239c877aeea23f499e9c3023d51f0b807f423" gracePeriod=600 Sep 15 17:36:29.730688 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.730544 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy" containerID="cri-o://9b9f75c1ab62bd7561ad8efc3c647a865dd5ac76b7947bce46d82d57cd2e47fe" gracePeriod=600 Sep 15 17:36:29.893418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893383 2562 generic.go:356] "Generic (PLEG): container finished" podID="60d06d68-5d74-4538-a229-30c219f999f5" containerID="b8a2f71f3d17e214cdbdb0bd9de239c877aeea23f499e9c3023d51f0b807f423" exitCode=0 Sep 15 17:36:29.893418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893408 2562 generic.go:356] "Generic (PLEG): container finished" podID="60d06d68-5d74-4538-a229-30c219f999f5" containerID="9b9f75c1ab62bd7561ad8efc3c647a865dd5ac76b7947bce46d82d57cd2e47fe" exitCode=0 Sep 15 17:36:29.893418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893415 2562 generic.go:356] "Generic (PLEG): container finished" podID="60d06d68-5d74-4538-a229-30c219f999f5" containerID="3154ade5d358938b0074ae33020d276a8b597746cf3ed4c19b8b37a156b7cfda" exitCode=0 Sep 15 17:36:29.893418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893421 2562 generic.go:356] "Generic (PLEG): container finished" podID="60d06d68-5d74-4538-a229-30c219f999f5" containerID="1f453ca1aa962f74a98eb9fc2af589e8c9eaf5802eab9794f877db0b2f2ca741" exitCode=0 Sep 15 17:36:29.893418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893426 2562 generic.go:356] "Generic (PLEG): container finished" podID="60d06d68-5d74-4538-a229-30c219f999f5" containerID="55cbc67c8969e61c796e5eaf8fba5605374e7db84a9b08cd69297f95aba5fd74" exitCode=0 Sep 15 17:36:29.893418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893431 2562 generic.go:356] "Generic (PLEG): container finished" podID="60d06d68-5d74-4538-a229-30c219f999f5" containerID="877cf336d47fe9a4c6a0f9d6afbfbe718b59c7a487138398889192ed2d9caaf5" exitCode=0 Sep 15 17:36:29.893838 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893495 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"b8a2f71f3d17e214cdbdb0bd9de239c877aeea23f499e9c3023d51f0b807f423"} Sep 15 17:36:29.893838 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"9b9f75c1ab62bd7561ad8efc3c647a865dd5ac76b7947bce46d82d57cd2e47fe"} Sep 15 17:36:29.893838 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893577 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"3154ade5d358938b0074ae33020d276a8b597746cf3ed4c19b8b37a156b7cfda"} Sep 15 17:36:29.893838 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"1f453ca1aa962f74a98eb9fc2af589e8c9eaf5802eab9794f877db0b2f2ca741"} Sep 15 17:36:29.893838 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893625 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"55cbc67c8969e61c796e5eaf8fba5605374e7db84a9b08cd69297f95aba5fd74"} Sep 15 17:36:29.893838 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.893650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"877cf336d47fe9a4c6a0f9d6afbfbe718b59c7a487138398889192ed2d9caaf5"} Sep 15 17:36:29.976584 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:29.976559 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:30.121511 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121411 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-1\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121511 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121466 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lvzj\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-kube-api-access-2lvzj\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121511 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121516 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-kubelet-serving-ca-bundle\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121547 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-grpc-tls\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121584 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121609 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-kube-rbac-proxy\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121633 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-2\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121654 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-web-config\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121688 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-trusted-ca-bundle\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121715 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-tls\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121746 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-config\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121772 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-db\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.121791 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121770 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121801 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-0\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121834 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-metrics-client-certs\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121857 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-config-out\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121884 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-tls-assets\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121896 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121914 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121945 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-serving-certs-ca-bundle\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121970 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-thanos-prometheus-http-client-file\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121996 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-metrics-client-ca\") pod \"60d06d68-5d74-4538-a229-30c219f999f5\" (UID: \"60d06d68-5d74-4538-a229-30c219f999f5\") " Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.121989 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.122249 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.122269 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.122351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.122285 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.122979 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.122595 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:30.123042 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.122988 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:30.124303 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.123316 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:30.124303 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.123442 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:30.124303 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.124052 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:36:30.124627 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.124600 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.125034 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.125009 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.125155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.125069 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.125418 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.125390 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.125830 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.125802 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-kube-api-access-2lvzj" (OuterVolumeSpecName: "kube-api-access-2lvzj") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "kube-api-access-2lvzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:36:30.126176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.126124 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.126499 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.126465 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-config-out" (OuterVolumeSpecName: "config-out") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:36:30.126672 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.126635 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.126938 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.126902 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-config" (OuterVolumeSpecName: "config") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.126938 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.126919 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:36:30.127557 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.127523 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.137870 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.137851 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-web-config" (OuterVolumeSpecName: "web-config") pod "60d06d68-5d74-4538-a229-30c219f999f5" (UID: "60d06d68-5d74-4538-a229-30c219f999f5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:30.222938 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222885 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.222938 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222932 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.222938 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222943 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.222938 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222953 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-configmap-metrics-client-ca\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222963 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lvzj\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-kube-api-access-2lvzj\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222973 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-grpc-tls\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222981 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222990 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-kube-rbac-proxy\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.222998 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-web-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223006 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223014 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223022 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223029 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-db\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223038 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60d06d68-5d74-4538-a229-30c219f999f5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223046 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60d06d68-5d74-4538-a229-30c219f999f5-secret-metrics-client-certs\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223054 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60d06d68-5d74-4538-a229-30c219f999f5-config-out\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.223220 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.223062 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60d06d68-5d74-4538-a229-30c219f999f5-tls-assets\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:36:30.900009 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.899978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60d06d68-5d74-4538-a229-30c219f999f5","Type":"ContainerDied","Data":"9fe686f1c3356ed05d8d974f9a38ae5fec556d9992a3b6fddf0b0a45b8218b45"} Sep 15 17:36:30.900459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.900039 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:30.900459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.900053 2562 scope.go:117] "RemoveContainer" containerID="b8a2f71f3d17e214cdbdb0bd9de239c877aeea23f499e9c3023d51f0b807f423" Sep 15 17:36:30.907000 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.906982 2562 scope.go:117] "RemoveContainer" containerID="9b9f75c1ab62bd7561ad8efc3c647a865dd5ac76b7947bce46d82d57cd2e47fe" Sep 15 17:36:30.913445 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.913428 2562 scope.go:117] "RemoveContainer" containerID="3154ade5d358938b0074ae33020d276a8b597746cf3ed4c19b8b37a156b7cfda" Sep 15 17:36:30.919624 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.919610 2562 scope.go:117] "RemoveContainer" containerID="1f453ca1aa962f74a98eb9fc2af589e8c9eaf5802eab9794f877db0b2f2ca741" Sep 15 17:36:30.923022 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.923004 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:36:30.927257 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.927236 2562 scope.go:117] "RemoveContainer" containerID="55cbc67c8969e61c796e5eaf8fba5605374e7db84a9b08cd69297f95aba5fd74" Sep 15 17:36:30.929898 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.929871 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:36:30.934275 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.934257 2562 scope.go:117] "RemoveContainer" containerID="877cf336d47fe9a4c6a0f9d6afbfbe718b59c7a487138398889192ed2d9caaf5" Sep 15 17:36:30.940869 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.940853 2562 scope.go:117] "RemoveContainer" containerID="b199df3ee5e5d9a64f2e4cb22c18cac1d611b279c3cba55dd0f177ad442b2dd4" Sep 15 17:36:30.952907 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.952886 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:36:30.953201 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953187 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="init-config-reloader" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953204 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="init-config-reloader" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953212 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-thanos" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953217 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-thanos" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953227 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="thanos-sidecar" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953233 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="thanos-sidecar" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953240 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953246 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953254 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015e2d9c-4c93-4549-b206-126adce8886c" containerName="registry" Sep 15 17:36:30.953255 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953259 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="015e2d9c-4c93-4549-b206-126adce8886c" containerName="registry" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953269 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-web" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953274 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-web" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953281 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="config-reloader" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953286 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="config-reloader" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953294 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="prometheus" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953299 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="prometheus" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953336 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-thanos" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953342 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy-web" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953348 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="015e2d9c-4c93-4549-b206-126adce8886c" containerName="registry" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953354 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="prometheus" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953360 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="thanos-sidecar" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953365 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="kube-rbac-proxy" Sep 15 17:36:30.953529 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.953371 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d06d68-5d74-4538-a229-30c219f999f5" containerName="config-reloader" Sep 15 17:36:30.958516 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.958500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:30.961222 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 17:36:30.961318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961201 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 17:36:30.961318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 17:36:30.961318 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961222 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 17:36:30.961473 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961439 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 17:36:30.961473 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961453 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 17:36:30.961473 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 17:36:30.961799 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961782 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 17:36:30.961853 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.961825 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 17:36:30.962035 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.962008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-918o8nf2ubaee\"" Sep 15 17:36:30.962035 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.962018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 17:36:30.962035 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.962008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 17:36:30.962243 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.962044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 17:36:30.962243 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.962016 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 17:36:30.962243 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.962204 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-54j5b\"" Sep 15 17:36:30.964179 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.964155 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 17:36:30.966536 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.966518 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 17:36:30.978850 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:30.978823 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:36:31.031574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031574 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284b5ac3-ac67-4707-b823-aa93a7d16a9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-config\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.031789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.031967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.032014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284b5ac3-ac67-4707-b823-aa93a7d16a9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.032037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.032165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.032051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhcn\" (UniqueName: \"kubernetes.io/projected/284b5ac3-ac67-4707-b823-aa93a7d16a9c-kube-api-access-glhcn\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133338 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133338 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284b5ac3-ac67-4707-b823-aa93a7d16a9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133788 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.133788 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.133611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glhcn\" (UniqueName: \"kubernetes.io/projected/284b5ac3-ac67-4707-b823-aa93a7d16a9c-kube-api-access-glhcn\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284b5ac3-ac67-4707-b823-aa93a7d16a9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134201 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-config\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.134513 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.134452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.135256 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.135158 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.135256 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.135205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.137097 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.135495 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.137097 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.136129 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.137097 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.136623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.137097 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.136718 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.137695 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.137494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.137695 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.137616 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.137695 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.137631 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.138058 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.137982 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.138058 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.137987 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/284b5ac3-ac67-4707-b823-aa93a7d16a9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.138223 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.138191 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/284b5ac3-ac67-4707-b823-aa93a7d16a9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.138385 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.138364 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.138734 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.138658 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.139005 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.138988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-config\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.139602 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.139577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.139971 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.139949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/284b5ac3-ac67-4707-b823-aa93a7d16a9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.140056 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.140041 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/284b5ac3-ac67-4707-b823-aa93a7d16a9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.141822 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.141803 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhcn\" (UniqueName: \"kubernetes.io/projected/284b5ac3-ac67-4707-b823-aa93a7d16a9c-kube-api-access-glhcn\") pod \"prometheus-k8s-0\" (UID: \"284b5ac3-ac67-4707-b823-aa93a7d16a9c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.270037 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.269989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:36:31.549106 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.549060 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:36:31.550971 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:36:31.550933 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284b5ac3_ac67_4707_b823_aa93a7d16a9c.slice/crio-01b0f2096171a27f92c9adb7ef905723f9e9ba2f95e141a786db2581ca1aa2de WatchSource:0}: Error finding container 01b0f2096171a27f92c9adb7ef905723f9e9ba2f95e141a786db2581ca1aa2de: Status 404 returned error can't find the container with id 01b0f2096171a27f92c9adb7ef905723f9e9ba2f95e141a786db2581ca1aa2de Sep 15 17:36:31.906303 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.906218 2562 generic.go:356] "Generic (PLEG): container finished" podID="284b5ac3-ac67-4707-b823-aa93a7d16a9c" containerID="6e67f25be4f10a9e161cb647517a1241cb6b1329022b69c8ef9bc441ab62fbcd" exitCode=0 Sep 15 17:36:31.906303 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.906282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerDied","Data":"6e67f25be4f10a9e161cb647517a1241cb6b1329022b69c8ef9bc441ab62fbcd"} Sep 15 17:36:31.906678 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:31.906335 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerStarted","Data":"01b0f2096171a27f92c9adb7ef905723f9e9ba2f95e141a786db2581ca1aa2de"} Sep 15 17:36:32.742036 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.742001 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d06d68-5d74-4538-a229-30c219f999f5" path="/var/lib/kubelet/pods/60d06d68-5d74-4538-a229-30c219f999f5/volumes" Sep 15 17:36:32.912186 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.912105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerStarted","Data":"80b6223150c6e07e2cf7f070b93d66b293936f474bc709e28df76def1235a1b0"} Sep 15 17:36:32.912186 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.912168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerStarted","Data":"2a424ecbcc5c8834da3645d2cdf8bbebc12d0a3f6e930ff6d100bc2c282d8b62"} Sep 15 17:36:32.912538 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.912198 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerStarted","Data":"1d7bfca329b632ff52bb28a980e6255138a527385057962f471088384ebda372"} Sep 15 17:36:32.912538 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.912227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerStarted","Data":"002f9a3076332e439528367a5f66db32089f304fa48aa1ba9f1d44023af75ee5"} Sep 15 17:36:32.912538 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.912262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerStarted","Data":"69a0cd25bb864cd3654f18b19c0cce5f032778c52082ef46df8c40fc64989be8"} Sep 15 17:36:32.912538 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.912286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"284b5ac3-ac67-4707-b823-aa93a7d16a9c","Type":"ContainerStarted","Data":"f8bc97e426e5a1a763ebf54d65f725453d596f3ecb4537e705860fc15daab23e"} Sep 15 17:36:32.947911 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:32.947856 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.929129138 podStartE2EDuration="2.94783428s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.705142ms" isStatefulPod=false podCreationTimestamp="2026-09-15 17:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:36:32.946063299 +0000 UTC m=+360.704175170" watchObservedRunningTime="2026-09-15 17:36:32.94783428 +0000 UTC m=+360.705946152" Sep 15 17:36:36.270650 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:36:36.270614 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:37:31.270609 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:37:31.270571 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:37:31.285701 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:37:31.285677 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:37:32.146689 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:37:32.146658 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:38:35.882396 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.882363 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g"] Sep 15 17:38:35.885259 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.885244 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:35.887575 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.887551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0c9fe52-5819-4a5f-bb86-4092b26f89a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wgw8g\" (UID: \"d0c9fe52-5819-4a5f-bb86-4092b26f89a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:35.887672 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.887614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vgng\" (UniqueName: \"kubernetes.io/projected/d0c9fe52-5819-4a5f-bb86-4092b26f89a2-kube-api-access-2vgng\") pod \"openshift-lws-operator-fd8ccff4c-wgw8g\" (UID: \"d0c9fe52-5819-4a5f-bb86-4092b26f89a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:35.887826 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.887813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cxhpj\"" Sep 15 17:38:35.888869 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.888853 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 15 17:38:35.888964 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.888947 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:38:35.897013 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.896994 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g"] Sep 15 17:38:35.987968 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.987941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0c9fe52-5819-4a5f-bb86-4092b26f89a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wgw8g\" (UID: \"d0c9fe52-5819-4a5f-bb86-4092b26f89a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:35.987968 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.987983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vgng\" (UniqueName: \"kubernetes.io/projected/d0c9fe52-5819-4a5f-bb86-4092b26f89a2-kube-api-access-2vgng\") pod \"openshift-lws-operator-fd8ccff4c-wgw8g\" (UID: \"d0c9fe52-5819-4a5f-bb86-4092b26f89a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:35.988300 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.988283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0c9fe52-5819-4a5f-bb86-4092b26f89a2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wgw8g\" (UID: \"d0c9fe52-5819-4a5f-bb86-4092b26f89a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:35.996809 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:35.996792 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vgng\" (UniqueName: \"kubernetes.io/projected/d0c9fe52-5819-4a5f-bb86-4092b26f89a2-kube-api-access-2vgng\") pod \"openshift-lws-operator-fd8ccff4c-wgw8g\" (UID: \"d0c9fe52-5819-4a5f-bb86-4092b26f89a2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:36.194331 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:36.194248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" Sep 15 17:38:36.461891 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:36.461867 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g"] Sep 15 17:38:36.464287 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:38:36.464260 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0c9fe52_5819_4a5f_bb86_4092b26f89a2.slice/crio-4d2643674cb70f00125c67e25067419394b4e767de3a954c433a4ce7d904b6b0 WatchSource:0}: Error finding container 4d2643674cb70f00125c67e25067419394b4e767de3a954c433a4ce7d904b6b0: Status 404 returned error can't find the container with id 4d2643674cb70f00125c67e25067419394b4e767de3a954c433a4ce7d904b6b0 Sep 15 17:38:36.465794 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:36.465777 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 17:38:37.360601 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:37.360541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" event={"ID":"d0c9fe52-5819-4a5f-bb86-4092b26f89a2","Type":"ContainerStarted","Data":"4d2643674cb70f00125c67e25067419394b4e767de3a954c433a4ce7d904b6b0"} Sep 15 17:38:39.370353 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:39.370319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" event={"ID":"d0c9fe52-5819-4a5f-bb86-4092b26f89a2","Type":"ContainerStarted","Data":"0f2a828462af335369559d977329eaed0a02e19d297a72041f1781fa4297b7af"} Sep 15 17:38:39.395403 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:39.395359 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wgw8g" podStartSLOduration=2.051468836 podStartE2EDuration="4.395345047s" totalImagesPullingTime="2.343876211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:39.393917019 +0000 UTC m=+487.152028892" watchObservedRunningTime="2026-09-15 17:38:39.395345047 +0000 UTC m=+487.153456918" Sep 15 17:38:56.835741 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.835707 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd"] Sep 15 17:38:56.838550 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.838534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:56.840948 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.840925 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 15 17:38:56.841071 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.840956 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 15 17:38:56.841280 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.841265 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2pqsq\"" Sep 15 17:38:56.841449 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.841437 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 15 17:38:56.841717 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.841705 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 15 17:38:56.852596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.852573 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd"] Sep 15 17:38:56.950999 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.950967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bf4562-7163-445e-be57-be9889f7deb1-webhook-cert\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:56.950999 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.951002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jzvw\" (UniqueName: \"kubernetes.io/projected/85bf4562-7163-445e-be57-be9889f7deb1-kube-api-access-7jzvw\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:56.951293 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.951026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85bf4562-7163-445e-be57-be9889f7deb1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:56.951293 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.951073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85bf4562-7163-445e-be57-be9889f7deb1-tmp\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:56.951293 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:56.951102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/85bf4562-7163-445e-be57-be9889f7deb1-manifests\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.052026 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.051996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bf4562-7163-445e-be57-be9889f7deb1-webhook-cert\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.052182 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.052030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jzvw\" (UniqueName: \"kubernetes.io/projected/85bf4562-7163-445e-be57-be9889f7deb1-kube-api-access-7jzvw\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.052182 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.052053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85bf4562-7163-445e-be57-be9889f7deb1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.052182 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.052111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85bf4562-7163-445e-be57-be9889f7deb1-tmp\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.052182 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.052130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/85bf4562-7163-445e-be57-be9889f7deb1-manifests\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.052555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.052531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/85bf4562-7163-445e-be57-be9889f7deb1-manifests\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.054338 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.054317 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85bf4562-7163-445e-be57-be9889f7deb1-tmp\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.054527 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.054507 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85bf4562-7163-445e-be57-be9889f7deb1-webhook-cert\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.054590 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.054518 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/85bf4562-7163-445e-be57-be9889f7deb1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.071180 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.071162 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jzvw\" (UniqueName: \"kubernetes.io/projected/85bf4562-7163-445e-be57-be9889f7deb1-kube-api-access-7jzvw\") pod \"opendatahub-operator-controller-manager-55876947b7-md4xd\" (UID: \"85bf4562-7163-445e-be57-be9889f7deb1\") " pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.148839 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.148786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:38:57.424860 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.424791 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd"] Sep 15 17:38:57.428515 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:38:57.428492 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85bf4562_7163_445e_be57_be9889f7deb1.slice/crio-75214faa42fa8d39f6877cbb08f64cdd36920a6dfbd1ccc745a849fc0c0fdb08 WatchSource:0}: Error finding container 75214faa42fa8d39f6877cbb08f64cdd36920a6dfbd1ccc745a849fc0c0fdb08: Status 404 returned error can't find the container with id 75214faa42fa8d39f6877cbb08f64cdd36920a6dfbd1ccc745a849fc0c0fdb08 Sep 15 17:38:57.441990 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:38:57.441968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" event={"ID":"85bf4562-7163-445e-be57-be9889f7deb1","Type":"ContainerStarted","Data":"75214faa42fa8d39f6877cbb08f64cdd36920a6dfbd1ccc745a849fc0c0fdb08"} Sep 15 17:39:00.463161 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:00.463123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" event={"ID":"85bf4562-7163-445e-be57-be9889f7deb1","Type":"ContainerStarted","Data":"643f29e7e720a856b1127cf70b94f668dd19882c3be451e45fd8defa9b16a2d3"} Sep 15 17:39:01.470267 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:01.470236 2562 generic.go:356] "Generic (PLEG): container finished" podID="85bf4562-7163-445e-be57-be9889f7deb1" containerID="643f29e7e720a856b1127cf70b94f668dd19882c3be451e45fd8defa9b16a2d3" exitCode=0 Sep 15 17:39:01.470570 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:01.470312 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" event={"ID":"85bf4562-7163-445e-be57-be9889f7deb1","Type":"ContainerDied","Data":"643f29e7e720a856b1127cf70b94f668dd19882c3be451e45fd8defa9b16a2d3"} Sep 15 17:39:02.475899 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:02.475865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" event={"ID":"85bf4562-7163-445e-be57-be9889f7deb1","Type":"ContainerStarted","Data":"5d9f89d7023adce61850248f5496d022865e8c4cff93b502938fa6788099b5da"} Sep 15 17:39:02.476317 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:02.476024 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:39:02.502424 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:02.502373 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" podStartSLOduration=2.048559967 podStartE2EDuration="6.502357789s" totalImagesPullingTime="3.379317439s" totalInitContainerRuntime="1.074480383s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:02.50097254 +0000 UTC m=+510.259084446" watchObservedRunningTime="2026-09-15 17:39:02.502357789 +0000 UTC m=+510.260469660" Sep 15 17:39:13.482459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.482428 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55876947b7-md4xd" Sep 15 17:39:13.668539 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.668512 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9"] Sep 15 17:39:13.805497 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.805426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9"] Sep 15 17:39:13.805629 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.805583 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.808442 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.808422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6wvd6\"" Sep 15 17:39:13.808605 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.808587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 15 17:39:13.808660 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.808599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 15 17:39:13.808660 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.808641 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 15 17:39:13.891988 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.891957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvmdh\" (UniqueName: \"kubernetes.io/projected/cd3e436d-9916-4165-a961-f24f68a53413-kube-api-access-tvmdh\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.891988 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.891994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd3e436d-9916-4165-a961-f24f68a53413-manager-config\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.892238 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.892028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd3e436d-9916-4165-a961-f24f68a53413-cert\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.892238 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.892193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd3e436d-9916-4165-a961-f24f68a53413-metrics-cert\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.993253 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.993228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd3e436d-9916-4165-a961-f24f68a53413-manager-config\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.993424 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.993269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd3e436d-9916-4165-a961-f24f68a53413-cert\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.993424 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.993319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd3e436d-9916-4165-a961-f24f68a53413-metrics-cert\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.993424 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.993374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvmdh\" (UniqueName: \"kubernetes.io/projected/cd3e436d-9916-4165-a961-f24f68a53413-kube-api-access-tvmdh\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.993962 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.993939 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd3e436d-9916-4165-a961-f24f68a53413-manager-config\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.995804 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.995785 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd3e436d-9916-4165-a961-f24f68a53413-metrics-cert\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:13.995879 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:13.995847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd3e436d-9916-4165-a961-f24f68a53413-cert\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:14.000945 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:14.000921 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvmdh\" (UniqueName: \"kubernetes.io/projected/cd3e436d-9916-4165-a961-f24f68a53413-kube-api-access-tvmdh\") pod \"lws-controller-manager-6888d799b5-lkql9\" (UID: \"cd3e436d-9916-4165-a961-f24f68a53413\") " pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:14.115345 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:14.115260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:14.401525 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:14.401503 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9"] Sep 15 17:39:14.404177 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:39:14.404148 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3e436d_9916_4165_a961_f24f68a53413.slice/crio-016edde0e4cff2525d0f6b5defe24a0f71aa099529dcd10da55384531c5009b9 WatchSource:0}: Error finding container 016edde0e4cff2525d0f6b5defe24a0f71aa099529dcd10da55384531c5009b9: Status 404 returned error can't find the container with id 016edde0e4cff2525d0f6b5defe24a0f71aa099529dcd10da55384531c5009b9 Sep 15 17:39:14.525949 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:14.525911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" event={"ID":"cd3e436d-9916-4165-a961-f24f68a53413","Type":"ContainerStarted","Data":"016edde0e4cff2525d0f6b5defe24a0f71aa099529dcd10da55384531c5009b9"} Sep 15 17:39:16.536445 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:16.536416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" event={"ID":"cd3e436d-9916-4165-a961-f24f68a53413","Type":"ContainerStarted","Data":"a80a12d62f96507d2b36919edc5c57d402afd56c4eead7dc416a784b3a1223b3"} Sep 15 17:39:16.536820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:16.536474 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:16.557861 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:16.557802 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" podStartSLOduration=1.9767756410000001 podStartE2EDuration="3.557781979s" totalImagesPullingTime="1.581006338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:16.557769079 +0000 UTC m=+524.315880949" watchObservedRunningTime="2026-09-15 17:39:16.557781979 +0000 UTC m=+524.315893850" Sep 15 17:39:22.600459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.600428 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn"] Sep 15 17:39:22.602710 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.602691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.605250 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.605219 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tf8dj\"" Sep 15 17:39:22.605250 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.605240 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 15 17:39:22.614429 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.614405 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn"] Sep 15 17:39:22.766306 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52566cc-ce02-44c4-b5b8-2636550723b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbs7s\" (UniqueName: \"kubernetes.io/projected/c52566cc-ce02-44c4-b5b8-2636550723b1-kube-api-access-wbs7s\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766459 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766590 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766590 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766590 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.766590 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.766534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867415 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867415 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867615 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867615 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867615 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867615 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52566cc-ce02-44c4-b5b8-2636550723b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbs7s\" (UniqueName: \"kubernetes.io/projected/c52566cc-ce02-44c4-b5b8-2636550723b1-kube-api-access-wbs7s\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.867820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.868017 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867980 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.868017 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.867986 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.868181 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.868160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.868343 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.868325 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c52566cc-ce02-44c4-b5b8-2636550723b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.869810 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.869789 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.870017 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.869998 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.899799 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.899775 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c52566cc-ce02-44c4-b5b8-2636550723b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.903559 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.903537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbs7s\" (UniqueName: \"kubernetes.io/projected/c52566cc-ce02-44c4-b5b8-2636550723b1-kube-api-access-wbs7s\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn\" (UID: \"c52566cc-ce02-44c4-b5b8-2636550723b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:22.914978 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:22.914961 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:23.186000 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:23.185929 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn"] Sep 15 17:39:23.188894 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:39:23.188872 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52566cc_ce02_44c4_b5b8_2636550723b1.slice/crio-5734143c1df93f14b372d225c080be4d26f7a18a9538090babe5d4f1e49920b6 WatchSource:0}: Error finding container 5734143c1df93f14b372d225c080be4d26f7a18a9538090babe5d4f1e49920b6: Status 404 returned error can't find the container with id 5734143c1df93f14b372d225c080be4d26f7a18a9538090babe5d4f1e49920b6 Sep 15 17:39:23.571130 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:23.571092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" event={"ID":"c52566cc-ce02-44c4-b5b8-2636550723b1","Type":"ContainerStarted","Data":"5734143c1df93f14b372d225c080be4d26f7a18a9538090babe5d4f1e49920b6"} Sep 15 17:39:26.340628 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.340589 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:39:26.340932 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.340673 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:39:26.340932 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.340708 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:39:26.586521 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.586483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" event={"ID":"c52566cc-ce02-44c4-b5b8-2636550723b1","Type":"ContainerStarted","Data":"d1f8a003eb58a353a2172f99cda4124e9c29b40a1ac088bdb838c55e9609d273"} Sep 15 17:39:26.615377 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.615284 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" podStartSLOduration=1.465745949 podStartE2EDuration="4.615269927s" totalImagesPullingTime="3.149523978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:26.613900384 +0000 UTC m=+534.372012255" watchObservedRunningTime="2026-09-15 17:39:26.615269927 +0000 UTC m=+534.373381797" Sep 15 17:39:26.635491 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.635465 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qvh4x"] Sep 15 17:39:26.638300 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.638285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:26.640642 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.640619 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 15 17:39:26.640747 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.640666 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hdlr8\"" Sep 15 17:39:26.647755 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.647730 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qvh4x"] Sep 15 17:39:26.804974 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.804940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmqtc\" (UniqueName: \"kubernetes.io/projected/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-kube-api-access-fmqtc\") pod \"odh-model-controller-7998c67dc4-qvh4x\" (UID: \"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:26.805157 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.805028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-cert\") pod \"odh-model-controller-7998c67dc4-qvh4x\" (UID: \"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:26.905971 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.905883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-cert\") pod \"odh-model-controller-7998c67dc4-qvh4x\" (UID: \"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:26.905971 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.905955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmqtc\" (UniqueName: \"kubernetes.io/projected/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-kube-api-access-fmqtc\") pod \"odh-model-controller-7998c67dc4-qvh4x\" (UID: \"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:26.906213 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:39:26.906035 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 15 17:39:26.906213 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:39:26.906133 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-cert podName:1c5e58dc-91d5-4444-9f0e-ac8fd23a569c nodeName:}" failed. No retries permitted until 2026-09-15 17:39:27.406112744 +0000 UTC m=+535.164224599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-cert") pod "odh-model-controller-7998c67dc4-qvh4x" (UID: "1c5e58dc-91d5-4444-9f0e-ac8fd23a569c") : secret "odh-model-controller-webhook-cert" not found Sep 15 17:39:26.915344 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.915323 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmqtc\" (UniqueName: \"kubernetes.io/projected/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-kube-api-access-fmqtc\") pod \"odh-model-controller-7998c67dc4-qvh4x\" (UID: \"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:26.915472 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:26.915406 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:27.290055 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.290020 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x9zmc"] Sep 15 17:39:27.293441 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.293421 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.295718 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.295700 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 15 17:39:27.295825 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.295724 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5mjrk\"" Sep 15 17:39:27.302468 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.302446 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x9zmc"] Sep 15 17:39:27.410335 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.410303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06adfeda-5a6a-4801-bcbe-27307847298d-tls-certs\") pod \"model-serving-api-54d89bd5fc-x9zmc\" (UID: \"06adfeda-5a6a-4801-bcbe-27307847298d\") " pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.410683 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.410352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-cert\") pod \"odh-model-controller-7998c67dc4-qvh4x\" (UID: \"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:27.410683 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.410373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zn57\" (UniqueName: \"kubernetes.io/projected/06adfeda-5a6a-4801-bcbe-27307847298d-kube-api-access-6zn57\") pod \"model-serving-api-54d89bd5fc-x9zmc\" (UID: \"06adfeda-5a6a-4801-bcbe-27307847298d\") " pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.412703 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.412685 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5e58dc-91d5-4444-9f0e-ac8fd23a569c-cert\") pod \"odh-model-controller-7998c67dc4-qvh4x\" (UID: \"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c\") " pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:27.511127 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.511069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06adfeda-5a6a-4801-bcbe-27307847298d-tls-certs\") pod \"model-serving-api-54d89bd5fc-x9zmc\" (UID: \"06adfeda-5a6a-4801-bcbe-27307847298d\") " pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.511274 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.511140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zn57\" (UniqueName: \"kubernetes.io/projected/06adfeda-5a6a-4801-bcbe-27307847298d-kube-api-access-6zn57\") pod \"model-serving-api-54d89bd5fc-x9zmc\" (UID: \"06adfeda-5a6a-4801-bcbe-27307847298d\") " pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.513691 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.513664 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06adfeda-5a6a-4801-bcbe-27307847298d-tls-certs\") pod \"model-serving-api-54d89bd5fc-x9zmc\" (UID: \"06adfeda-5a6a-4801-bcbe-27307847298d\") " pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.518632 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.518606 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zn57\" (UniqueName: \"kubernetes.io/projected/06adfeda-5a6a-4801-bcbe-27307847298d-kube-api-access-6zn57\") pod \"model-serving-api-54d89bd5fc-x9zmc\" (UID: \"06adfeda-5a6a-4801-bcbe-27307847298d\") " pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.543405 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.543356 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6888d799b5-lkql9" Sep 15 17:39:27.549656 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.549640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:27.605787 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.605757 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:27.830108 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.830070 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qvh4x"] Sep 15 17:39:27.832061 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:39:27.832029 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5e58dc_91d5_4444_9f0e_ac8fd23a569c.slice/crio-844417d64f9e3c20ff47e99c045cb5b34701a821f0b273dbe8b8c0c95e93355e WatchSource:0}: Error finding container 844417d64f9e3c20ff47e99c045cb5b34701a821f0b273dbe8b8c0c95e93355e: Status 404 returned error can't find the container with id 844417d64f9e3c20ff47e99c045cb5b34701a821f0b273dbe8b8c0c95e93355e Sep 15 17:39:27.895358 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.895334 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x9zmc"] Sep 15 17:39:27.899337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:39:27.899303 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06adfeda_5a6a_4801_bcbe_27307847298d.slice/crio-ae5c64d8b08d4eeaff6da10617ff340a012a7c45439e93f4e0aaef9df33c92de WatchSource:0}: Error finding container ae5c64d8b08d4eeaff6da10617ff340a012a7c45439e93f4e0aaef9df33c92de: Status 404 returned error can't find the container with id ae5c64d8b08d4eeaff6da10617ff340a012a7c45439e93f4e0aaef9df33c92de Sep 15 17:39:27.920490 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:27.920472 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:28.604683 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:28.604641 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" event={"ID":"06adfeda-5a6a-4801-bcbe-27307847298d","Type":"ContainerStarted","Data":"ae5c64d8b08d4eeaff6da10617ff340a012a7c45439e93f4e0aaef9df33c92de"} Sep 15 17:39:28.606347 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:28.606308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" event={"ID":"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c","Type":"ContainerStarted","Data":"844417d64f9e3c20ff47e99c045cb5b34701a821f0b273dbe8b8c0c95e93355e"} Sep 15 17:39:28.606592 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:28.606571 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:28.607738 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:28.607715 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn" Sep 15 17:39:32.629613 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:32.629581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" event={"ID":"1c5e58dc-91d5-4444-9f0e-ac8fd23a569c","Type":"ContainerStarted","Data":"dbbfaf72012b2d3bdeef690297537dec78d3ca50f91caeb58a730c8fc588fc50"} Sep 15 17:39:32.630044 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:32.629663 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:32.631099 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:32.631057 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" event={"ID":"06adfeda-5a6a-4801-bcbe-27307847298d","Type":"ContainerStarted","Data":"7166ef9f593063606ddd02e68d0eb1c2100decb87aedd1403419805b2f544492"} Sep 15 17:39:32.631236 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:32.631222 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:39:32.646667 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:32.646625 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" podStartSLOduration=2.579109902 podStartE2EDuration="6.646614242s" totalImagesPullingTime="4.06750434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:32.645258881 +0000 UTC m=+540.403370751" watchObservedRunningTime="2026-09-15 17:39:32.646614242 +0000 UTC m=+540.404726127" Sep 15 17:39:32.661510 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:32.661462 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" podStartSLOduration=1.624012797 podStartE2EDuration="5.66144452s" totalImagesPullingTime="4.037431723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:32.659920489 +0000 UTC m=+540.418032366" watchObservedRunningTime="2026-09-15 17:39:32.66144452 +0000 UTC m=+540.419556392" Sep 15 17:39:36.961160 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.961129 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd"] Sep 15 17:39:36.966148 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.966127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:36.968619 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.968599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 15 17:39:36.968713 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.968680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7hnbd\"" Sep 15 17:39:36.975312 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.975245 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd"] Sep 15 17:39:36.976743 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.976721 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd"] Sep 15 17:39:36.979906 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.979884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:36.982463 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.982445 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-94ktd\"" Sep 15 17:39:36.982463 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.982457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 15 17:39:36.991216 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.991197 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd"] Sep 15 17:39:36.994828 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.994808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20fea29-1994-44e7-a065-3e4937556041-cert\") pod \"kserve-controller-manager-d6f4b65b8-cd8dd\" (UID: \"b20fea29-1994-44e7-a065-3e4937556041\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:36.994932 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.994887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvtfc\" (UniqueName: \"kubernetes.io/projected/b20fea29-1994-44e7-a065-3e4937556041-kube-api-access-wvtfc\") pod \"kserve-controller-manager-d6f4b65b8-cd8dd\" (UID: \"b20fea29-1994-44e7-a065-3e4937556041\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:36.994932 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.994919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-475dd\" (UID: \"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:36.995019 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:36.994946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hb4f\" (UniqueName: \"kubernetes.io/projected/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-kube-api-access-2hb4f\") pod \"llmisvc-controller-manager-777c6bd7d5-475dd\" (UID: \"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:37.095957 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.095922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvtfc\" (UniqueName: \"kubernetes.io/projected/b20fea29-1994-44e7-a065-3e4937556041-kube-api-access-wvtfc\") pod \"kserve-controller-manager-d6f4b65b8-cd8dd\" (UID: \"b20fea29-1994-44e7-a065-3e4937556041\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:37.095957 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.095959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-475dd\" (UID: \"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:37.096204 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:39:37.096051 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 15 17:39:37.096204 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.096105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hb4f\" (UniqueName: \"kubernetes.io/projected/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-kube-api-access-2hb4f\") pod \"llmisvc-controller-manager-777c6bd7d5-475dd\" (UID: \"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:37.096204 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:39:37.096126 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-cert podName:c8cb85bb-a9b1-456c-9141-58b9c5d13bb9 nodeName:}" failed. No retries permitted until 2026-09-15 17:39:37.596109096 +0000 UTC m=+545.354220945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-cert") pod "llmisvc-controller-manager-777c6bd7d5-475dd" (UID: "c8cb85bb-a9b1-456c-9141-58b9c5d13bb9") : secret "llmisvc-webhook-server-cert" not found Sep 15 17:39:37.096204 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.096160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20fea29-1994-44e7-a065-3e4937556041-cert\") pod \"kserve-controller-manager-d6f4b65b8-cd8dd\" (UID: \"b20fea29-1994-44e7-a065-3e4937556041\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:37.098675 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.098654 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b20fea29-1994-44e7-a065-3e4937556041-cert\") pod \"kserve-controller-manager-d6f4b65b8-cd8dd\" (UID: \"b20fea29-1994-44e7-a065-3e4937556041\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:37.104494 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.104471 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvtfc\" (UniqueName: \"kubernetes.io/projected/b20fea29-1994-44e7-a065-3e4937556041-kube-api-access-wvtfc\") pod \"kserve-controller-manager-d6f4b65b8-cd8dd\" (UID: \"b20fea29-1994-44e7-a065-3e4937556041\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:37.105304 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.105283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hb4f\" (UniqueName: \"kubernetes.io/projected/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-kube-api-access-2hb4f\") pod \"llmisvc-controller-manager-777c6bd7d5-475dd\" (UID: \"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:37.277970 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.277937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:37.556251 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.556173 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd"] Sep 15 17:39:37.558824 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:39:37.558796 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20fea29_1994_44e7_a065_3e4937556041.slice/crio-0341527d1b2ee2378c9a33d83090a36b2de91989273b2f320d3bc0ad728bc2b7 WatchSource:0}: Error finding container 0341527d1b2ee2378c9a33d83090a36b2de91989273b2f320d3bc0ad728bc2b7: Status 404 returned error can't find the container with id 0341527d1b2ee2378c9a33d83090a36b2de91989273b2f320d3bc0ad728bc2b7 Sep 15 17:39:37.599925 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.599902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-475dd\" (UID: \"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:37.602289 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.602269 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8cb85bb-a9b1-456c-9141-58b9c5d13bb9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-475dd\" (UID: \"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:37.652429 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.652394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" event={"ID":"b20fea29-1994-44e7-a065-3e4937556041","Type":"ContainerStarted","Data":"0341527d1b2ee2378c9a33d83090a36b2de91989273b2f320d3bc0ad728bc2b7"} Sep 15 17:39:37.890904 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:37.890812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:38.174999 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:38.174973 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd"] Sep 15 17:39:38.177068 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:39:38.177038 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8cb85bb_a9b1_456c_9141_58b9c5d13bb9.slice/crio-6dde59e4d6953e880fc792c9895b2e4aadfc57f99a4920748904c4276947a48e WatchSource:0}: Error finding container 6dde59e4d6953e880fc792c9895b2e4aadfc57f99a4920748904c4276947a48e: Status 404 returned error can't find the container with id 6dde59e4d6953e880fc792c9895b2e4aadfc57f99a4920748904c4276947a48e Sep 15 17:39:38.659472 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:38.659436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" event={"ID":"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9","Type":"ContainerStarted","Data":"6dde59e4d6953e880fc792c9895b2e4aadfc57f99a4920748904c4276947a48e"} Sep 15 17:39:41.680677 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:41.680640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" event={"ID":"b20fea29-1994-44e7-a065-3e4937556041","Type":"ContainerStarted","Data":"730f9ac990bb11fd4d1597c1d0c1b7695c83e48c2e58b76bc0b9bee51b32641b"} Sep 15 17:39:41.681136 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:41.680778 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:39:41.682219 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:41.682194 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" event={"ID":"c8cb85bb-a9b1-456c-9141-58b9c5d13bb9","Type":"ContainerStarted","Data":"733719aa9f75d50a619e0c3a3d855b890cc1665f5fb35275249d31d8f8ce2fed"} Sep 15 17:39:41.682353 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:41.682241 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:39:41.697018 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:41.696974 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" podStartSLOduration=2.6045773519999997 podStartE2EDuration="5.696960406s" totalImagesPullingTime="3.092383054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:41.696410604 +0000 UTC m=+549.454522480" watchObservedRunningTime="2026-09-15 17:39:41.696960406 +0000 UTC m=+549.455072277" Sep 15 17:39:41.712409 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:41.712367 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" podStartSLOduration=2.378341336 podStartE2EDuration="5.712352824s" totalImagesPullingTime="3.334011488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:41.710689973 +0000 UTC m=+549.468801844" watchObservedRunningTime="2026-09-15 17:39:41.712352824 +0000 UTC m=+549.470464694" Sep 15 17:39:43.637676 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:43.637650 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qvh4x" Sep 15 17:39:43.640807 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:39:43.640782 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-x9zmc" Sep 15 17:40:12.688128 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:12.688069 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-475dd" Sep 15 17:40:12.691010 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:12.690988 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cd8dd" Sep 15 17:40:32.665976 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:32.665944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:40:32.666523 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:32.665944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:40:55.573117 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.573032 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb"] Sep 15 17:40:55.575364 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.575347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" Sep 15 17:40:55.577965 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.577948 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 15 17:40:55.578063 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.577994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-82qb4\"" Sep 15 17:40:55.578063 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.578003 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 15 17:40:55.578911 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.578896 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 15 17:40:55.588046 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.588023 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb"] Sep 15 17:40:55.667714 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.667676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58tm\" (UniqueName: \"kubernetes.io/projected/394ae592-dbf5-4015-8db7-39a4ce09da4e-kube-api-access-c58tm\") pod \"dns-operator-controller-manager-7b84cd7c9c-zvggb\" (UID: \"394ae592-dbf5-4015-8db7-39a4ce09da4e\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" Sep 15 17:40:55.769054 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.769017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58tm\" (UniqueName: \"kubernetes.io/projected/394ae592-dbf5-4015-8db7-39a4ce09da4e-kube-api-access-c58tm\") pod \"dns-operator-controller-manager-7b84cd7c9c-zvggb\" (UID: \"394ae592-dbf5-4015-8db7-39a4ce09da4e\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" Sep 15 17:40:55.779269 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.779246 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58tm\" (UniqueName: \"kubernetes.io/projected/394ae592-dbf5-4015-8db7-39a4ce09da4e-kube-api-access-c58tm\") pod \"dns-operator-controller-manager-7b84cd7c9c-zvggb\" (UID: \"394ae592-dbf5-4015-8db7-39a4ce09da4e\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" Sep 15 17:40:55.885762 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:55.885674 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" Sep 15 17:40:56.162406 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:56.162384 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb"] Sep 15 17:40:56.164580 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:40:56.164551 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394ae592_dbf5_4015_8db7_39a4ce09da4e.slice/crio-a9168a2da2039f5f96f6bff600ac0a2afc802b5ea0898c6b6feaa9e67cb76028 WatchSource:0}: Error finding container a9168a2da2039f5f96f6bff600ac0a2afc802b5ea0898c6b6feaa9e67cb76028: Status 404 returned error can't find the container with id a9168a2da2039f5f96f6bff600ac0a2afc802b5ea0898c6b6feaa9e67cb76028 Sep 15 17:40:57.002624 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:40:57.002589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" event={"ID":"394ae592-dbf5-4015-8db7-39a4ce09da4e","Type":"ContainerStarted","Data":"a9168a2da2039f5f96f6bff600ac0a2afc802b5ea0898c6b6feaa9e67cb76028"} Sep 15 17:41:04.037132 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:04.037070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" event={"ID":"394ae592-dbf5-4015-8db7-39a4ce09da4e","Type":"ContainerStarted","Data":"02070e33edf08958a81de1ed7979621e44c5acc6024ea000ff3ad1483a37b3ef"} Sep 15 17:41:04.037577 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:04.037155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" Sep 15 17:41:04.055940 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:04.055897 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" podStartSLOduration=2.058362765 podStartE2EDuration="9.055881792s" totalImagesPullingTime="6.997519027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:41:04.054188628 +0000 UTC m=+631.812300500" watchObservedRunningTime="2026-09-15 17:41:04.055881792 +0000 UTC m=+631.813993663" Sep 15 17:41:10.796938 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.796903 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w"] Sep 15 17:41:10.799683 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.799668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:10.802331 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.802310 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sprjd\"" Sep 15 17:41:10.815249 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.815224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w"] Sep 15 17:41:10.898759 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.898728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2kl6\" (UniqueName: \"kubernetes.io/projected/c2951fcf-68da-40f2-a981-4334ad1153ad-kube-api-access-s2kl6\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:10.898917 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.898848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2951fcf-68da-40f2-a981-4334ad1153ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:10.999623 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.999590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2951fcf-68da-40f2-a981-4334ad1153ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:10.999788 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.999640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2kl6\" (UniqueName: \"kubernetes.io/projected/c2951fcf-68da-40f2-a981-4334ad1153ad-kube-api-access-s2kl6\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:10.999977 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:10.999958 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2951fcf-68da-40f2-a981-4334ad1153ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:11.008412 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.008385 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w"] Sep 15 17:41:11.008650 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:41:11.008633 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-s2kl6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" podUID="c2951fcf-68da-40f2-a981-4334ad1153ad" Sep 15 17:41:11.012049 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.012029 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2kl6\" (UniqueName: \"kubernetes.io/projected/c2951fcf-68da-40f2-a981-4334ad1153ad-kube-api-access-s2kl6\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:11.066348 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.066277 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:11.072744 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.072720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:11.100624 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.100604 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2951fcf-68da-40f2-a981-4334ad1153ad-extensions-socket-volume\") pod \"c2951fcf-68da-40f2-a981-4334ad1153ad\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " Sep 15 17:41:11.100766 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.100652 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2kl6\" (UniqueName: \"kubernetes.io/projected/c2951fcf-68da-40f2-a981-4334ad1153ad-kube-api-access-s2kl6\") pod \"c2951fcf-68da-40f2-a981-4334ad1153ad\" (UID: \"c2951fcf-68da-40f2-a981-4334ad1153ad\") " Sep 15 17:41:11.101155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.100782 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2951fcf-68da-40f2-a981-4334ad1153ad-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c2951fcf-68da-40f2-a981-4334ad1153ad" (UID: "c2951fcf-68da-40f2-a981-4334ad1153ad"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:41:11.104583 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.104551 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2951fcf-68da-40f2-a981-4334ad1153ad-kube-api-access-s2kl6" (OuterVolumeSpecName: "kube-api-access-s2kl6") pod "c2951fcf-68da-40f2-a981-4334ad1153ad" (UID: "c2951fcf-68da-40f2-a981-4334ad1153ad"). InnerVolumeSpecName "kube-api-access-s2kl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:41:11.202264 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.202227 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2951fcf-68da-40f2-a981-4334ad1153ad-extensions-socket-volume\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:41:11.202264 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.202258 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2kl6\" (UniqueName: \"kubernetes.io/projected/c2951fcf-68da-40f2-a981-4334ad1153ad-kube-api-access-s2kl6\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:41:11.822608 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.822571 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w"] Sep 15 17:41:11.831065 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.831037 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w"] Sep 15 17:41:11.870507 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.870477 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6"] Sep 15 17:41:11.873072 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.873049 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:11.888020 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.887991 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6"] Sep 15 17:41:11.909392 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.909362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxlc\" (UniqueName: \"kubernetes.io/projected/f446a5ee-8be4-460b-bbae-ddc21378e219-kube-api-access-9xxlc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qjkp6\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:11.909544 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:11.909414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f446a5ee-8be4-460b-bbae-ddc21378e219-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qjkp6\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:12.010765 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.010725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxlc\" (UniqueName: \"kubernetes.io/projected/f446a5ee-8be4-460b-bbae-ddc21378e219-kube-api-access-9xxlc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qjkp6\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:12.010765 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.010772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f446a5ee-8be4-460b-bbae-ddc21378e219-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qjkp6\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:12.011155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.011137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f446a5ee-8be4-460b-bbae-ddc21378e219-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qjkp6\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:12.018994 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.018971 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxlc\" (UniqueName: \"kubernetes.io/projected/f446a5ee-8be4-460b-bbae-ddc21378e219-kube-api-access-9xxlc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qjkp6\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:12.070365 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.070334 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:12.072657 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:41:12.072593 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" podUID="c2951fcf-68da-40f2-a981-4334ad1153ad" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:12.078497 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:41:12.078472 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" podUID="c2951fcf-68da-40f2-a981-4334ad1153ad" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:12.184293 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.184256 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:12.456290 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.456221 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6"] Sep 15 17:41:12.460039 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:41:12.460006 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf446a5ee_8be4_460b_bbae_ddc21378e219.slice/crio-f504978380b6ab0e66c6c4534972c31872740d6f3f95bb6e7c824390b52f3a5e WatchSource:0}: Error finding container f504978380b6ab0e66c6c4534972c31872740d6f3f95bb6e7c824390b52f3a5e: Status 404 returned error can't find the container with id f504978380b6ab0e66c6c4534972c31872740d6f3f95bb6e7c824390b52f3a5e Sep 15 17:41:12.741320 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:41:12.741273 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-29l5w\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" podUID="c2951fcf-68da-40f2-a981-4334ad1153ad" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-29l5w" Sep 15 17:41:12.742354 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:12.742336 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2951fcf-68da-40f2-a981-4334ad1153ad" path="/var/lib/kubelet/pods/c2951fcf-68da-40f2-a981-4334ad1153ad/volumes" Sep 15 17:41:13.075963 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:13.075871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" event={"ID":"f446a5ee-8be4-460b-bbae-ddc21378e219","Type":"ContainerStarted","Data":"f504978380b6ab0e66c6c4534972c31872740d6f3f95bb6e7c824390b52f3a5e"} Sep 15 17:41:15.044053 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:15.044017 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-zvggb" Sep 15 17:41:17.099464 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:17.099389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" event={"ID":"f446a5ee-8be4-460b-bbae-ddc21378e219","Type":"ContainerStarted","Data":"36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95"} Sep 15 17:41:17.099464 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:17.099459 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:17.125944 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:17.125896 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" podStartSLOduration=1.8278045870000001 podStartE2EDuration="6.125881128s" totalImagesPullingTime="4.298076541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:41:17.124342282 +0000 UTC m=+644.882454157" watchObservedRunningTime="2026-09-15 17:41:17.125881128 +0000 UTC m=+644.883992998" Sep 15 17:41:23.720904 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:23.720873 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6"] Sep 15 17:41:23.721322 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:23.721055 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" podUID="f446a5ee-8be4-460b-bbae-ddc21378e219" containerName="manager" containerID="cri-o://36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95" gracePeriod=10 Sep 15 17:41:23.723154 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:23.723131 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:23.963325 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:23.963296 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:24.021939 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.021862 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xxlc\" (UniqueName: \"kubernetes.io/projected/f446a5ee-8be4-460b-bbae-ddc21378e219-kube-api-access-9xxlc\") pod \"f446a5ee-8be4-460b-bbae-ddc21378e219\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " Sep 15 17:41:24.022097 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.022000 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f446a5ee-8be4-460b-bbae-ddc21378e219-extensions-socket-volume\") pod \"f446a5ee-8be4-460b-bbae-ddc21378e219\" (UID: \"f446a5ee-8be4-460b-bbae-ddc21378e219\") " Sep 15 17:41:24.022474 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.022451 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f446a5ee-8be4-460b-bbae-ddc21378e219-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f446a5ee-8be4-460b-bbae-ddc21378e219" (UID: "f446a5ee-8be4-460b-bbae-ddc21378e219"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:41:24.024103 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.024069 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f446a5ee-8be4-460b-bbae-ddc21378e219-kube-api-access-9xxlc" (OuterVolumeSpecName: "kube-api-access-9xxlc") pod "f446a5ee-8be4-460b-bbae-ddc21378e219" (UID: "f446a5ee-8be4-460b-bbae-ddc21378e219"). InnerVolumeSpecName "kube-api-access-9xxlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:41:24.123121 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.123070 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f446a5ee-8be4-460b-bbae-ddc21378e219-extensions-socket-volume\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:41:24.123121 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.123111 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xxlc\" (UniqueName: \"kubernetes.io/projected/f446a5ee-8be4-460b-bbae-ddc21378e219-kube-api-access-9xxlc\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:41:24.132993 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.132961 2562 generic.go:356] "Generic (PLEG): container finished" podID="f446a5ee-8be4-460b-bbae-ddc21378e219" containerID="36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95" exitCode=0 Sep 15 17:41:24.132993 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.132990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" event={"ID":"f446a5ee-8be4-460b-bbae-ddc21378e219","Type":"ContainerDied","Data":"36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95"} Sep 15 17:41:24.133219 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.133018 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" Sep 15 17:41:24.133219 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.133043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6" event={"ID":"f446a5ee-8be4-460b-bbae-ddc21378e219","Type":"ContainerDied","Data":"f504978380b6ab0e66c6c4534972c31872740d6f3f95bb6e7c824390b52f3a5e"} Sep 15 17:41:24.133219 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.133065 2562 scope.go:117] "RemoveContainer" containerID="36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95" Sep 15 17:41:24.141761 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.141744 2562 scope.go:117] "RemoveContainer" containerID="36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95" Sep 15 17:41:24.142001 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:41:24.141982 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95\": container with ID starting with 36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95 not found: ID does not exist" containerID="36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95" Sep 15 17:41:24.142051 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.142009 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95"} err="failed to get container status \"36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95\": rpc error: code = NotFound desc = could not find container \"36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95\": container with ID starting with 36cb54ad598c41e895090d960b890dca3255e7c8b67e9d86e06a0a6618670d95 not found: ID does not exist" Sep 15 17:41:24.168259 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.168226 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6"] Sep 15 17:41:24.175548 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.175524 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qjkp6"] Sep 15 17:41:24.741956 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:24.741912 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f446a5ee-8be4-460b-bbae-ddc21378e219" path="/var/lib/kubelet/pods/f446a5ee-8be4-460b-bbae-ddc21378e219/volumes" Sep 15 17:41:40.271667 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.271629 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n"] Sep 15 17:41:40.272160 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.272035 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f446a5ee-8be4-460b-bbae-ddc21378e219" containerName="manager" Sep 15 17:41:40.272160 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.272051 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f446a5ee-8be4-460b-bbae-ddc21378e219" containerName="manager" Sep 15 17:41:40.272160 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.272138 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f446a5ee-8be4-460b-bbae-ddc21378e219" containerName="manager" Sep 15 17:41:40.277271 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.277251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.279561 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.279544 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2xtdt\"" Sep 15 17:41:40.287714 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.287691 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n"] Sep 15 17:41:40.361881 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.361852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362050 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.361888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362050 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.361918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs26b\" (UniqueName: \"kubernetes.io/projected/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-kube-api-access-xs26b\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362050 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.361944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362050 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.362034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362227 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.362140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362227 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.362174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362227 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.362215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.362347 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.362237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463199 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463199 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463394 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs26b\" (UniqueName: \"kubernetes.io/projected/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-kube-api-access-xs26b\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463394 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463468 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463468 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463566 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463566 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463566 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463697 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463649 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463751 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463690 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463917 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463897 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.463985 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.463963 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.464056 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.464039 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.465595 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.465577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.465926 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.465909 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.472583 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.472554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs26b\" (UniqueName: \"kubernetes.io/projected/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-kube-api-access-xs26b\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.472721 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.472702 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97bf5f7-a816-44ea-a17a-e7dffd3833ff-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2ds9n\" (UID: \"b97bf5f7-a816-44ea-a17a-e7dffd3833ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.588256 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.588184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:40.862847 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.862821 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n"] Sep 15 17:41:40.864750 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:41:40.864718 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97bf5f7_a816_44ea_a17a_e7dffd3833ff.slice/crio-0a53a39838f9aa0c0de9fa739ecabc5cd818276d6b504d7c91e7ce88fd5c44da WatchSource:0}: Error finding container 0a53a39838f9aa0c0de9fa739ecabc5cd818276d6b504d7c91e7ce88fd5c44da: Status 404 returned error can't find the container with id 0a53a39838f9aa0c0de9fa739ecabc5cd818276d6b504d7c91e7ce88fd5c44da Sep 15 17:41:40.866861 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.866830 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:41:40.866954 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.866896 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:41:40.866954 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:40.866933 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:41:41.208663 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:41.208577 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" event={"ID":"b97bf5f7-a816-44ea-a17a-e7dffd3833ff","Type":"ContainerStarted","Data":"4c630a1e1e179f5013033ffd36d647436f0cc89ddbb4f104a733d49902e3c44f"} Sep 15 17:41:41.208663 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:41.208637 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" event={"ID":"b97bf5f7-a816-44ea-a17a-e7dffd3833ff","Type":"ContainerStarted","Data":"0a53a39838f9aa0c0de9fa739ecabc5cd818276d6b504d7c91e7ce88fd5c44da"} Sep 15 17:41:41.226911 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:41.226851 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" podStartSLOduration=1.226837393 podStartE2EDuration="1.226837393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:41:41.22499333 +0000 UTC m=+668.983105202" watchObservedRunningTime="2026-09-15 17:41:41.226837393 +0000 UTC m=+668.984949264" Sep 15 17:41:41.589017 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:41.588983 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:41.593666 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:41.593641 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:42.212990 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:42.212962 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:42.213948 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:42.213934 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:41:54.420351 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.420318 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvkb2"] Sep 15 17:41:54.422632 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.422616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.425264 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.425238 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lzsh2\"" Sep 15 17:41:54.425371 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.425297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 15 17:41:54.436118 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.436094 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvkb2"] Sep 15 17:41:54.486176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.486143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7cn\" (UniqueName: \"kubernetes.io/projected/6297edb7-066c-4163-9bc8-9b119203627a-kube-api-access-hh7cn\") pod \"limitador-limitador-8588749977-xvkb2\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.486334 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.486295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6297edb7-066c-4163-9bc8-9b119203627a-config-file\") pod \"limitador-limitador-8588749977-xvkb2\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.521515 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.517413 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvkb2"] Sep 15 17:41:54.587092 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.587035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6297edb7-066c-4163-9bc8-9b119203627a-config-file\") pod \"limitador-limitador-8588749977-xvkb2\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.587271 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.587145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7cn\" (UniqueName: \"kubernetes.io/projected/6297edb7-066c-4163-9bc8-9b119203627a-kube-api-access-hh7cn\") pod \"limitador-limitador-8588749977-xvkb2\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.587675 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.587655 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6297edb7-066c-4163-9bc8-9b119203627a-config-file\") pod \"limitador-limitador-8588749977-xvkb2\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.595441 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.595409 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7cn\" (UniqueName: \"kubernetes.io/projected/6297edb7-066c-4163-9bc8-9b119203627a-kube-api-access-hh7cn\") pod \"limitador-limitador-8588749977-xvkb2\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.733019 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.732987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:41:54.999663 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:54.999642 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvkb2"] Sep 15 17:41:55.001692 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:41:55.001666 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6297edb7_066c_4163_9bc8_9b119203627a.slice/crio-85afe050347e43c956237f42a0b11c1aee3ed93fc98dea397f016c461f39a105 WatchSource:0}: Error finding container 85afe050347e43c956237f42a0b11c1aee3ed93fc98dea397f016c461f39a105: Status 404 returned error can't find the container with id 85afe050347e43c956237f42a0b11c1aee3ed93fc98dea397f016c461f39a105 Sep 15 17:41:55.268859 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:55.268776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" event={"ID":"6297edb7-066c-4163-9bc8-9b119203627a","Type":"ContainerStarted","Data":"85afe050347e43c956237f42a0b11c1aee3ed93fc98dea397f016c461f39a105"} Sep 15 17:41:56.275054 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:56.275024 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" event={"ID":"6297edb7-066c-4163-9bc8-9b119203627a","Type":"ContainerStarted","Data":"e12b6f8b0c0e16ecb1661d1a59b24c887e558e6019f757110b282ec47b0f4e53"} Sep 15 17:41:56.291522 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:56.291474 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" podStartSLOduration=1.096713283 podStartE2EDuration="2.291457387s" totalImagesPullingTime="1.194744104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:41:56.290102718 +0000 UTC m=+684.048214585" watchObservedRunningTime="2026-09-15 17:41:56.291457387 +0000 UTC m=+684.049569259" Sep 15 17:41:57.279964 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:41:57.279926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:42:07.906146 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:07.906113 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvkb2"] Sep 15 17:42:07.906550 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:07.906302 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" podUID="6297edb7-066c-4163-9bc8-9b119203627a" containerName="limitador" containerID="cri-o://e12b6f8b0c0e16ecb1661d1a59b24c887e558e6019f757110b282ec47b0f4e53" gracePeriod=30 Sep 15 17:42:07.907192 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:07.906885 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:42:08.329971 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.329947 2562 generic.go:356] "Generic (PLEG): container finished" podID="6297edb7-066c-4163-9bc8-9b119203627a" containerID="e12b6f8b0c0e16ecb1661d1a59b24c887e558e6019f757110b282ec47b0f4e53" exitCode=0 Sep 15 17:42:08.330104 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.329996 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" event={"ID":"6297edb7-066c-4163-9bc8-9b119203627a","Type":"ContainerDied","Data":"e12b6f8b0c0e16ecb1661d1a59b24c887e558e6019f757110b282ec47b0f4e53"} Sep 15 17:42:08.459629 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.459602 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:42:08.507999 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.507973 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh7cn\" (UniqueName: \"kubernetes.io/projected/6297edb7-066c-4163-9bc8-9b119203627a-kube-api-access-hh7cn\") pod \"6297edb7-066c-4163-9bc8-9b119203627a\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " Sep 15 17:42:08.508174 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.508009 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6297edb7-066c-4163-9bc8-9b119203627a-config-file\") pod \"6297edb7-066c-4163-9bc8-9b119203627a\" (UID: \"6297edb7-066c-4163-9bc8-9b119203627a\") " Sep 15 17:42:08.508384 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.508354 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6297edb7-066c-4163-9bc8-9b119203627a-config-file" (OuterVolumeSpecName: "config-file") pod "6297edb7-066c-4163-9bc8-9b119203627a" (UID: "6297edb7-066c-4163-9bc8-9b119203627a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:42:08.510024 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.509997 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6297edb7-066c-4163-9bc8-9b119203627a-kube-api-access-hh7cn" (OuterVolumeSpecName: "kube-api-access-hh7cn") pod "6297edb7-066c-4163-9bc8-9b119203627a" (UID: "6297edb7-066c-4163-9bc8-9b119203627a"). InnerVolumeSpecName "kube-api-access-hh7cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:42:08.608961 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.608928 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh7cn\" (UniqueName: \"kubernetes.io/projected/6297edb7-066c-4163-9bc8-9b119203627a-kube-api-access-hh7cn\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:42:08.608961 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:08.608957 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6297edb7-066c-4163-9bc8-9b119203627a-config-file\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:42:09.335770 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:09.335737 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" Sep 15 17:42:09.336223 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:09.335741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvkb2" event={"ID":"6297edb7-066c-4163-9bc8-9b119203627a","Type":"ContainerDied","Data":"85afe050347e43c956237f42a0b11c1aee3ed93fc98dea397f016c461f39a105"} Sep 15 17:42:09.336223 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:09.335864 2562 scope.go:117] "RemoveContainer" containerID="e12b6f8b0c0e16ecb1661d1a59b24c887e558e6019f757110b282ec47b0f4e53" Sep 15 17:42:09.350288 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:09.350260 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvkb2"] Sep 15 17:42:09.352132 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:09.352109 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvkb2"] Sep 15 17:42:10.742570 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:10.742542 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6297edb7-066c-4163-9bc8-9b119203627a" path="/var/lib/kubelet/pods/6297edb7-066c-4163-9bc8-9b119203627a/volumes" Sep 15 17:42:14.300425 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.300393 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5p45q"] Sep 15 17:42:14.300781 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.300735 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6297edb7-066c-4163-9bc8-9b119203627a" containerName="limitador" Sep 15 17:42:14.300781 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.300751 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6297edb7-066c-4163-9bc8-9b119203627a" containerName="limitador" Sep 15 17:42:14.300867 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.300853 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6297edb7-066c-4163-9bc8-9b119203627a" containerName="limitador" Sep 15 17:42:14.305599 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.305576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.307917 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.307895 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 15 17:42:14.308033 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.307906 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 15 17:42:14.308978 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.308951 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 15 17:42:14.309100 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.309012 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cb8v4\"" Sep 15 17:42:14.311375 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.311350 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5p45q"] Sep 15 17:42:14.354636 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.354610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bf6573be-f810-4611-a15b-6d89cb44d6b9-data\") pod \"postgres-69fb4594cf-5p45q\" (UID: \"bf6573be-f810-4611-a15b-6d89cb44d6b9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.354776 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.354641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/bf6573be-f810-4611-a15b-6d89cb44d6b9-kube-api-access-pljhx\") pod \"postgres-69fb4594cf-5p45q\" (UID: \"bf6573be-f810-4611-a15b-6d89cb44d6b9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.455563 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.455531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bf6573be-f810-4611-a15b-6d89cb44d6b9-data\") pod \"postgres-69fb4594cf-5p45q\" (UID: \"bf6573be-f810-4611-a15b-6d89cb44d6b9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.455563 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.455565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/bf6573be-f810-4611-a15b-6d89cb44d6b9-kube-api-access-pljhx\") pod \"postgres-69fb4594cf-5p45q\" (UID: \"bf6573be-f810-4611-a15b-6d89cb44d6b9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.455959 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.455935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bf6573be-f810-4611-a15b-6d89cb44d6b9-data\") pod \"postgres-69fb4594cf-5p45q\" (UID: \"bf6573be-f810-4611-a15b-6d89cb44d6b9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.463676 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.463652 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pljhx\" (UniqueName: \"kubernetes.io/projected/bf6573be-f810-4611-a15b-6d89cb44d6b9-kube-api-access-pljhx\") pod \"postgres-69fb4594cf-5p45q\" (UID: \"bf6573be-f810-4611-a15b-6d89cb44d6b9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.617138 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.617027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:14.884609 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:14.884586 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5p45q"] Sep 15 17:42:14.886959 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:42:14.886934 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6573be_f810_4611_a15b_6d89cb44d6b9.slice/crio-ed1f36b17e1d48e21dfc2e56e549600406cc0b84ec8bd3c11615e461917d836b WatchSource:0}: Error finding container ed1f36b17e1d48e21dfc2e56e549600406cc0b84ec8bd3c11615e461917d836b: Status 404 returned error can't find the container with id ed1f36b17e1d48e21dfc2e56e549600406cc0b84ec8bd3c11615e461917d836b Sep 15 17:42:15.365541 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:15.365505 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" event={"ID":"bf6573be-f810-4611-a15b-6d89cb44d6b9","Type":"ContainerStarted","Data":"ed1f36b17e1d48e21dfc2e56e549600406cc0b84ec8bd3c11615e461917d836b"} Sep 15 17:42:20.398329 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:20.398283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" event={"ID":"bf6573be-f810-4611-a15b-6d89cb44d6b9","Type":"ContainerStarted","Data":"cc20192dad90a6f916ccfb6c1b3aaed7f229d20ec6769a5b5b1f04e04154ecfc"} Sep 15 17:42:20.398834 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:20.398402 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:20.413526 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:20.413476 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" podStartSLOduration=1.4555922159999999 podStartE2EDuration="6.4134591s" totalImagesPullingTime="4.957866884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:42:20.412476711 +0000 UTC m=+708.170588585" watchObservedRunningTime="2026-09-15 17:42:20.4134591 +0000 UTC m=+708.171570973" Sep 15 17:42:26.430438 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:26.430369 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5p45q" Sep 15 17:42:35.684258 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.684227 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-c6dtv"] Sep 15 17:42:35.700697 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.700662 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-c6dtv"] Sep 15 17:42:35.700844 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.700798 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.703566 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.703284 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 15 17:42:35.703566 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.703286 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 15 17:42:35.703566 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.703294 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cb87s\"" Sep 15 17:42:35.704288 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.704267 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 15 17:42:35.846500 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.846470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-metrics-certs\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.846717 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.846505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9gfb\" (UniqueName: \"kubernetes.io/projected/74fa7e95-fdcb-4900-bb2a-5a11148100a3-kube-api-access-s9gfb\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.846717 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.846629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.873873 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.873839 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6458bc4d69-wl5r6"] Sep 15 17:42:35.877997 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.877969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:35.885130 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.885052 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6458bc4d69-wl5r6"] Sep 15 17:42:35.947417 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.947332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-metrics-certs\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.947417 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.947372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9gfb\" (UniqueName: \"kubernetes.io/projected/74fa7e95-fdcb-4900-bb2a-5a11148100a3-kube-api-access-s9gfb\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.947587 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.947438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.947587 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:42:35.947543 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 15 17:42:35.947652 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:42:35.947598 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert podName:74fa7e95-fdcb-4900-bb2a-5a11148100a3 nodeName:}" failed. No retries permitted until 2026-09-15 17:42:36.447579761 +0000 UTC m=+724.205691612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert") pod "maas-controller-75dc6cbdf-c6dtv" (UID: "74fa7e95-fdcb-4900-bb2a-5a11148100a3") : secret "maas-controller-webhook-cert" not found Sep 15 17:42:35.949747 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.949727 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-metrics-certs\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:35.957483 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:35.957461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9gfb\" (UniqueName: \"kubernetes.io/projected/74fa7e95-fdcb-4900-bb2a-5a11148100a3-kube-api-access-s9gfb\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:36.048223 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.048188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700824d9-8759-4f67-b924-52711c140de3-metrics-certs\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.048223 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.048228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/700824d9-8759-4f67-b924-52711c140de3-webhook-cert\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.048440 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.048253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxnc9\" (UniqueName: \"kubernetes.io/projected/700824d9-8759-4f67-b924-52711c140de3-kube-api-access-lxnc9\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.149099 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.149047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/700824d9-8759-4f67-b924-52711c140de3-webhook-cert\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.149284 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.149136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxnc9\" (UniqueName: \"kubernetes.io/projected/700824d9-8759-4f67-b924-52711c140de3-kube-api-access-lxnc9\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.149284 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.149260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700824d9-8759-4f67-b924-52711c140de3-metrics-certs\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.151625 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.151605 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/700824d9-8759-4f67-b924-52711c140de3-webhook-cert\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.151720 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.151637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/700824d9-8759-4f67-b924-52711c140de3-metrics-certs\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.156796 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.156773 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxnc9\" (UniqueName: \"kubernetes.io/projected/700824d9-8759-4f67-b924-52711c140de3-kube-api-access-lxnc9\") pod \"maas-controller-6458bc4d69-wl5r6\" (UID: \"700824d9-8759-4f67-b924-52711c140de3\") " pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.191776 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.191753 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:36.452401 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.452324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:36.454466 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.454446 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert\") pod \"maas-controller-75dc6cbdf-c6dtv\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:36.458402 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.458383 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6458bc4d69-wl5r6"] Sep 15 17:42:36.460811 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:42:36.460787 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700824d9_8759_4f67_b924_52711c140de3.slice/crio-f5d9e064da8c86d9e8cbac14b1a743950dfa6fa42deedf2064f5deeed5f1e0c1 WatchSource:0}: Error finding container f5d9e064da8c86d9e8cbac14b1a743950dfa6fa42deedf2064f5deeed5f1e0c1: Status 404 returned error can't find the container with id f5d9e064da8c86d9e8cbac14b1a743950dfa6fa42deedf2064f5deeed5f1e0c1 Sep 15 17:42:36.467347 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.467323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6458bc4d69-wl5r6" event={"ID":"700824d9-8759-4f67-b924-52711c140de3","Type":"ContainerStarted","Data":"f5d9e064da8c86d9e8cbac14b1a743950dfa6fa42deedf2064f5deeed5f1e0c1"} Sep 15 17:42:36.611881 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.611851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:36.878849 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:36.878814 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-c6dtv"] Sep 15 17:42:36.880962 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:42:36.880934 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fa7e95_fdcb_4900_bb2a_5a11148100a3.slice/crio-b13ebdd51e3b908603300085839079977b2e74236a21185bf33220c34110ffed WatchSource:0}: Error finding container b13ebdd51e3b908603300085839079977b2e74236a21185bf33220c34110ffed: Status 404 returned error can't find the container with id b13ebdd51e3b908603300085839079977b2e74236a21185bf33220c34110ffed Sep 15 17:42:37.477217 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:37.477176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" event={"ID":"74fa7e95-fdcb-4900-bb2a-5a11148100a3","Type":"ContainerStarted","Data":"b13ebdd51e3b908603300085839079977b2e74236a21185bf33220c34110ffed"} Sep 15 17:42:39.488373 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:39.488334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" event={"ID":"74fa7e95-fdcb-4900-bb2a-5a11148100a3","Type":"ContainerStarted","Data":"2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a"} Sep 15 17:42:39.488842 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:39.488427 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:39.490212 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:39.490189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6458bc4d69-wl5r6" event={"ID":"700824d9-8759-4f67-b924-52711c140de3","Type":"ContainerStarted","Data":"27187a699a3ecf4b0f675d5dd81cfc32e64725784cc119b06866fe440d6321a1"} Sep 15 17:42:39.490332 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:39.490252 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:39.527223 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:39.527171 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" podStartSLOduration=2.290574393 podStartE2EDuration="4.527155463s" totalImagesPullingTime="2.23658107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:42:39.525740701 +0000 UTC m=+727.283852566" watchObservedRunningTime="2026-09-15 17:42:39.527155463 +0000 UTC m=+727.285267333" Sep 15 17:42:39.552035 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:39.551982 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6458bc4d69-wl5r6" podStartSLOduration=1.902038353 podStartE2EDuration="4.551965972s" totalImagesPullingTime="2.649927619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:42:39.55039267 +0000 UTC m=+727.308504565" watchObservedRunningTime="2026-09-15 17:42:39.551965972 +0000 UTC m=+727.310077844" Sep 15 17:42:50.496755 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.496721 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:50.497155 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.497141 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6458bc4d69-wl5r6" Sep 15 17:42:50.554146 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.554113 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-c6dtv"] Sep 15 17:42:50.554364 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.554326 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" podUID="74fa7e95-fdcb-4900-bb2a-5a11148100a3" containerName="manager" containerID="cri-o://2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a" gracePeriod=30 Sep 15 17:42:50.891424 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.891402 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:50.983334 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.983306 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert\") pod \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " Sep 15 17:42:50.983469 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.983355 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9gfb\" (UniqueName: \"kubernetes.io/projected/74fa7e95-fdcb-4900-bb2a-5a11148100a3-kube-api-access-s9gfb\") pod \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " Sep 15 17:42:50.983469 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.983400 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-metrics-certs\") pod \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\" (UID: \"74fa7e95-fdcb-4900-bb2a-5a11148100a3\") " Sep 15 17:42:50.985555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.985517 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "74fa7e95-fdcb-4900-bb2a-5a11148100a3" (UID: "74fa7e95-fdcb-4900-bb2a-5a11148100a3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:42:50.985555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.985541 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "74fa7e95-fdcb-4900-bb2a-5a11148100a3" (UID: "74fa7e95-fdcb-4900-bb2a-5a11148100a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:42:50.985555 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:50.985549 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fa7e95-fdcb-4900-bb2a-5a11148100a3-kube-api-access-s9gfb" (OuterVolumeSpecName: "kube-api-access-s9gfb") pod "74fa7e95-fdcb-4900-bb2a-5a11148100a3" (UID: "74fa7e95-fdcb-4900-bb2a-5a11148100a3"). InnerVolumeSpecName "kube-api-access-s9gfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:42:51.084568 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.084487 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-webhook-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:42:51.084568 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.084513 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9gfb\" (UniqueName: \"kubernetes.io/projected/74fa7e95-fdcb-4900-bb2a-5a11148100a3-kube-api-access-s9gfb\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:42:51.084568 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.084522 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74fa7e95-fdcb-4900-bb2a-5a11148100a3-metrics-certs\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" Sep 15 17:42:51.542253 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.542220 2562 generic.go:356] "Generic (PLEG): container finished" podID="74fa7e95-fdcb-4900-bb2a-5a11148100a3" containerID="2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a" exitCode=0 Sep 15 17:42:51.542603 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.542266 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" Sep 15 17:42:51.542603 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.542302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" event={"ID":"74fa7e95-fdcb-4900-bb2a-5a11148100a3","Type":"ContainerDied","Data":"2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a"} Sep 15 17:42:51.542603 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.542351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-c6dtv" event={"ID":"74fa7e95-fdcb-4900-bb2a-5a11148100a3","Type":"ContainerDied","Data":"b13ebdd51e3b908603300085839079977b2e74236a21185bf33220c34110ffed"} Sep 15 17:42:51.542603 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.542375 2562 scope.go:117] "RemoveContainer" containerID="2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a" Sep 15 17:42:51.550968 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.550953 2562 scope.go:117] "RemoveContainer" containerID="2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a" Sep 15 17:42:51.551236 ip-10-0-143-65 kubenswrapper[2562]: E0915 17:42:51.551220 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a\": container with ID starting with 2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a not found: ID does not exist" containerID="2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a" Sep 15 17:42:51.551291 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.551242 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a"} err="failed to get container status \"2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a\": rpc error: code = NotFound desc = could not find container \"2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a\": container with ID starting with 2b925d1e9fa7d9565025192ed6cc61a927356a8f7c20a91ab99fadbabeb8b00a not found: ID does not exist" Sep 15 17:42:51.566014 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.565993 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-c6dtv"] Sep 15 17:42:51.570073 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:51.570055 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-c6dtv"] Sep 15 17:42:52.743437 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:42:52.743406 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74fa7e95-fdcb-4900-bb2a-5a11148100a3" path="/var/lib/kubelet/pods/74fa7e95-fdcb-4900-bb2a-5a11148100a3/volumes" Sep 15 17:43:09.070425 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.070390 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n"] Sep 15 17:43:09.070908 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.070733 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74fa7e95-fdcb-4900-bb2a-5a11148100a3" containerName="manager" Sep 15 17:43:09.070908 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.070744 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74fa7e95-fdcb-4900-bb2a-5a11148100a3" containerName="manager" Sep 15 17:43:09.070908 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.070803 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74fa7e95-fdcb-4900-bb2a-5a11148100a3" containerName="manager" Sep 15 17:43:09.110680 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.110645 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n"] Sep 15 17:43:09.110819 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.110737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.114589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.114564 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 15 17:43:09.114717 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.114592 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fllbt\"" Sep 15 17:43:09.114717 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.114620 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 15 17:43:09.244825 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.244789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f22r\" (UniqueName: \"kubernetes.io/projected/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-kube-api-access-6f22r\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.244825 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.244823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-maas-api-tls\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.245165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.244911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-openshift-service-ca\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.245165 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.244967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-metrics-certs\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.345593 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.345512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-openshift-service-ca\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.345593 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.345558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-metrics-certs\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.345825 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.345606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f22r\" (UniqueName: \"kubernetes.io/projected/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-kube-api-access-6f22r\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.345825 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.345623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-maas-api-tls\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.346241 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.346217 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-openshift-service-ca\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.348016 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.347996 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-maas-api-tls\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.348139 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.348123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-metrics-certs\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.354591 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.354568 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f22r\" (UniqueName: \"kubernetes.io/projected/84739bb0-1c64-40f8-8324-cc9e5cdbdec4-kube-api-access-6f22r\") pod \"maas-api-59f6566bbc-btb5n\" (UID: \"84739bb0-1c64-40f8-8324-cc9e5cdbdec4\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.421258 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.421227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:09.586534 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.586502 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cxnlp"] Sep 15 17:43:09.589394 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.589374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:09.593045 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.593025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4bsj8\"" Sep 15 17:43:09.593358 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.593340 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 15 17:43:09.606591 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.606567 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cxnlp"] Sep 15 17:43:09.705259 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.705237 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n"] Sep 15 17:43:09.707447 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:43:09.707418 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84739bb0_1c64_40f8_8324_cc9e5cdbdec4.slice/crio-c18027fc18e141c4f61b574d923786e5fe542054affa9a3aa9d7dc946e433af9 WatchSource:0}: Error finding container c18027fc18e141c4f61b574d923786e5fe542054affa9a3aa9d7dc946e433af9: Status 404 returned error can't find the container with id c18027fc18e141c4f61b574d923786e5fe542054affa9a3aa9d7dc946e433af9 Sep 15 17:43:09.748522 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.748487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czf7q\" (UniqueName: \"kubernetes.io/projected/162c74bb-888e-4f15-b443-bfe099ede615-kube-api-access-czf7q\") pod \"payload-processing-5b54b7fbb7-cxnlp\" (UID: \"162c74bb-888e-4f15-b443-bfe099ede615\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:09.748522 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.748523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/162c74bb-888e-4f15-b443-bfe099ede615-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cxnlp\" (UID: \"162c74bb-888e-4f15-b443-bfe099ede615\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:09.849940 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.849845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czf7q\" (UniqueName: \"kubernetes.io/projected/162c74bb-888e-4f15-b443-bfe099ede615-kube-api-access-czf7q\") pod \"payload-processing-5b54b7fbb7-cxnlp\" (UID: \"162c74bb-888e-4f15-b443-bfe099ede615\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:09.849940 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.849900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/162c74bb-888e-4f15-b443-bfe099ede615-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cxnlp\" (UID: \"162c74bb-888e-4f15-b443-bfe099ede615\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:09.850879 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.850837 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/162c74bb-888e-4f15-b443-bfe099ede615-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-cxnlp\" (UID: \"162c74bb-888e-4f15-b443-bfe099ede615\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:09.857589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.857567 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czf7q\" (UniqueName: \"kubernetes.io/projected/162c74bb-888e-4f15-b443-bfe099ede615-kube-api-access-czf7q\") pod \"payload-processing-5b54b7fbb7-cxnlp\" (UID: \"162c74bb-888e-4f15-b443-bfe099ede615\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:09.900401 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:09.900374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:10.168769 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:10.168600 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-cxnlp"] Sep 15 17:43:10.171337 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:43:10.171291 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162c74bb_888e_4f15_b443_bfe099ede615.slice/crio-2921148c2eca0be5d6d442c713aee3ebca1e9eb793f782b9d6cb6b996bfa79a8 WatchSource:0}: Error finding container 2921148c2eca0be5d6d442c713aee3ebca1e9eb793f782b9d6cb6b996bfa79a8: Status 404 returned error can't find the container with id 2921148c2eca0be5d6d442c713aee3ebca1e9eb793f782b9d6cb6b996bfa79a8 Sep 15 17:43:10.638933 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:10.638901 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" event={"ID":"162c74bb-888e-4f15-b443-bfe099ede615","Type":"ContainerStarted","Data":"2921148c2eca0be5d6d442c713aee3ebca1e9eb793f782b9d6cb6b996bfa79a8"} Sep 15 17:43:10.640276 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:10.640249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" event={"ID":"84739bb0-1c64-40f8-8324-cc9e5cdbdec4","Type":"ContainerStarted","Data":"c18027fc18e141c4f61b574d923786e5fe542054affa9a3aa9d7dc946e433af9"} Sep 15 17:43:12.677981 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:12.677940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" event={"ID":"84739bb0-1c64-40f8-8324-cc9e5cdbdec4","Type":"ContainerStarted","Data":"c2b9f09197174e6ec33dfb19a05aecac6c3a40f18d4f3dec3eae0e9ab8d08f5f"} Sep 15 17:43:12.678528 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:12.678072 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:12.697905 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:12.697855 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" podStartSLOduration=1.7033405510000001 podStartE2EDuration="3.69783757s" totalImagesPullingTime="1.994497019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:43:12.69516451 +0000 UTC m=+760.453276382" watchObservedRunningTime="2026-09-15 17:43:12.69783757 +0000 UTC m=+760.455949444" Sep 15 17:43:13.684617 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:13.684518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" event={"ID":"162c74bb-888e-4f15-b443-bfe099ede615","Type":"ContainerStarted","Data":"fceff82badafd190d04873c12d4702eeaf9ccba7e0cfbcc5de8759f30ac5e877"} Sep 15 17:43:13.701154 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:13.701102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" podStartSLOduration=1.629881884 podStartE2EDuration="4.70106058s" totalImagesPullingTime="3.071178696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:43:13.700138122 +0000 UTC m=+761.458249993" watchObservedRunningTime="2026-09-15 17:43:13.70106058 +0000 UTC m=+761.459172452" Sep 15 17:43:14.689916 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:14.689885 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:18.690745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:18.690711 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-btb5n" Sep 15 17:43:19.714725 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:19.714692 2562 generic.go:356] "Generic (PLEG): container finished" podID="b97bf5f7-a816-44ea-a17a-e7dffd3833ff" containerID="4c630a1e1e179f5013033ffd36d647436f0cc89ddbb4f104a733d49902e3c44f" exitCode=0 Sep 15 17:43:19.715216 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:19.714768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" event={"ID":"b97bf5f7-a816-44ea-a17a-e7dffd3833ff","Type":"ContainerDied","Data":"4c630a1e1e179f5013033ffd36d647436f0cc89ddbb4f104a733d49902e3c44f"} Sep 15 17:43:19.715216 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:19.715175 2562 scope.go:117] "RemoveContainer" containerID="4c630a1e1e179f5013033ffd36d647436f0cc89ddbb4f104a733d49902e3c44f" Sep 15 17:43:19.716119 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:19.716093 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:43:19.716217 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:19.716155 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:43:19.716217 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:19.716186 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 15 17:43:20.722305 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:20.722271 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" event={"ID":"b97bf5f7-a816-44ea-a17a-e7dffd3833ff","Type":"ContainerStarted","Data":"7426cbbac190bd4f720d548f65a37b83ad3e037eca0de8724cfde74d42159c18"} Sep 15 17:43:21.588669 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:21.588634 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:43:21.588914 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:21.588896 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2ds9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 15 17:43:21.588970 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:21.588937 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" podUID="b97bf5f7-a816-44ea-a17a-e7dffd3833ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 15 17:43:22.589440 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:22.589401 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2ds9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 15 17:43:22.589826 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:22.589475 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" podUID="b97bf5f7-a816-44ea-a17a-e7dffd3833ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 15 17:43:23.588858 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:23.588819 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2ds9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 15 17:43:23.589028 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:23.588874 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" podUID="b97bf5f7-a816-44ea-a17a-e7dffd3833ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 15 17:43:24.589335 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:24.589299 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2ds9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 15 17:43:24.589707 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:24.589350 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" podUID="b97bf5f7-a816-44ea-a17a-e7dffd3833ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 15 17:43:25.589266 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:25.589233 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2ds9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Sep 15 17:43:25.589443 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:25.589300 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" podUID="b97bf5f7-a816-44ea-a17a-e7dffd3833ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Sep 15 17:43:25.696745 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:25.696717 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-cxnlp" Sep 15 17:43:25.982517 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:25.982493 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cd8dd_b20fea29-1994-44e7-a065-3e4937556041/manager/0.log" Sep 15 17:43:26.106686 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.106662 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-475dd_c8cb85bb-a9b1-456c-9141-58b9c5d13bb9/manager/0.log" Sep 15 17:43:26.230616 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.230592 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6458bc4d69-wl5r6_700824d9-8759-4f67-b924-52711c140de3/manager/0.log" Sep 15 17:43:26.365474 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.365404 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x9zmc_06adfeda-5a6a-4801-bcbe-27307847298d/server/0.log" Sep 15 17:43:26.485789 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.485762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qvh4x_1c5e58dc-91d5-4444-9f0e-ac8fd23a569c/manager/0.log" Sep 15 17:43:26.592508 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.592485 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:43:26.592924 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.592764 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:43:26.593358 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.593341 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2ds9n" Sep 15 17:43:26.742499 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.742473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55876947b7-md4xd_85bf4562-7163-445e-be57-be9889f7deb1/copy-manifests/0.log" Sep 15 17:43:26.754098 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:26.754049 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55876947b7-md4xd_85bf4562-7163-445e-be57-be9889f7deb1/manager/0.log" Sep 15 17:43:27.232666 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:27.232641 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59f6566bbc-btb5n_84739bb0-1c64-40f8-8324-cc9e5cdbdec4/maas-api/0.log" Sep 15 17:43:27.363177 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:27.363150 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5p45q_bf6573be-f810-4611-a15b-6d89cb44d6b9/postgres/0.log" Sep 15 17:43:28.454787 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:28.454762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-zvggb_394ae592-dbf5-4015-8db7-39a4ce09da4e/manager/0.log" Sep 15 17:43:29.337732 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:29.337709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn_c52566cc-ce02-44c4-b5b8-2636550723b1/istio-proxy/0.log" Sep 15 17:43:29.849314 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:29.849280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2ds9n_b97bf5f7-a816-44ea-a17a-e7dffd3833ff/istio-proxy/1.log" Sep 15 17:43:30.103498 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:30.103427 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cxnlp_162c74bb-888e-4f15-b443-bfe099ede615/payload-processing/0.log" Sep 15 17:43:30.223800 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:30.223773 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6777464cb4-nw5hb_d3fe5ed1-4f96-4764-9360-ff058cbc91b9/router/0.log" Sep 15 17:43:39.296303 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:39.296274 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h9bvw_d408293d-1144-45a4-a887-c18aae4d190b/global-pull-secret-syncer/0.log" Sep 15 17:43:39.361733 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:39.361706 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lxf8d_6640a792-9ce0-430e-95e4-4fb05d8fc231/konnectivity-agent/0.log" Sep 15 17:43:39.459531 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:39.458875 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-65.ec2.internal_4f5d4104f78662c719231b0e8fdcd77c/haproxy/0.log" Sep 15 17:43:44.339949 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:44.339918 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-zvggb_394ae592-dbf5-4015-8db7-39a4ce09da4e/manager/0.log" Sep 15 17:43:46.147458 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.147380 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-267q8_25d580dd-2d6d-493a-8598-db6f07f14c23/cluster-monitoring-operator/0.log" Sep 15 17:43:46.310608 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.310578 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-j8h79_2175c4dd-1ae1-434d-9b17-126bb3c0e85e/monitoring-plugin/0.log" Sep 15 17:43:46.448224 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.448159 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffg67_4362d499-4a1e-4191-89c4-b499326d0a75/node-exporter/0.log" Sep 15 17:43:46.468782 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.468758 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffg67_4362d499-4a1e-4191-89c4-b499326d0a75/kube-rbac-proxy/0.log" Sep 15 17:43:46.501589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.501567 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ffg67_4362d499-4a1e-4191-89c4-b499326d0a75/init-textfile/0.log" Sep 15 17:43:46.726505 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.726482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_284b5ac3-ac67-4707-b823-aa93a7d16a9c/prometheus/0.log" Sep 15 17:43:46.748240 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.748219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_284b5ac3-ac67-4707-b823-aa93a7d16a9c/config-reloader/0.log" Sep 15 17:43:46.769908 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.769886 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_284b5ac3-ac67-4707-b823-aa93a7d16a9c/thanos-sidecar/0.log" Sep 15 17:43:46.791704 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.791684 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_284b5ac3-ac67-4707-b823-aa93a7d16a9c/kube-rbac-proxy-web/0.log" Sep 15 17:43:46.812991 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.812974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_284b5ac3-ac67-4707-b823-aa93a7d16a9c/kube-rbac-proxy/0.log" Sep 15 17:43:46.834918 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.834900 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_284b5ac3-ac67-4707-b823-aa93a7d16a9c/kube-rbac-proxy-thanos/0.log" Sep 15 17:43:46.855485 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.855469 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_284b5ac3-ac67-4707-b823-aa93a7d16a9c/init-config-reloader/0.log" Sep 15 17:43:46.880466 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.880445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-64n4z_71c575f1-dcf0-4f14-9b5a-6998a0eacfdd/prometheus-operator/0.log" Sep 15 17:43:46.902369 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:46.902354 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-64n4z_71c575f1-dcf0-4f14-9b5a-6998a0eacfdd/kube-rbac-proxy/0.log" Sep 15 17:43:48.903479 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:48.903445 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552"] Sep 15 17:43:48.908580 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:48.908559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:48.911171 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:48.911141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6l5ln\"/\"kube-root-ca.crt\"" Sep 15 17:43:48.911296 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:48.911203 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6l5ln\"/\"openshift-service-ca.crt\"" Sep 15 17:43:48.912207 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:48.912182 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6l5ln\"/\"default-dockercfg-2z5w8\"" Sep 15 17:43:48.914204 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:48.914187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552"] Sep 15 17:43:49.021336 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.021304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-proc\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.021504 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.021344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-sys\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.021504 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.021441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfwjf\" (UniqueName: \"kubernetes.io/projected/bf112761-3cea-4f86-bc09-009a2bca78e6-kube-api-access-qfwjf\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.021504 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.021497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-lib-modules\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.021616 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.021521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-podres\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.038280 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.038238 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/2.log" Sep 15 17:43:49.047046 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.042759 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-n9bgp_43c867b7-6b7a-4b02-ae12-705bb1e6b049/console-operator/3.log" Sep 15 17:43:49.122820 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.122794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfwjf\" (UniqueName: \"kubernetes.io/projected/bf112761-3cea-4f86-bc09-009a2bca78e6-kube-api-access-qfwjf\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.122971 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.122826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-lib-modules\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.122971 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.122846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-podres\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.122971 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.122965 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-podres\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.123161 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.122993 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-lib-modules\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.123161 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.123033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-proc\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.123161 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.123066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-sys\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.123161 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.123126 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-proc\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.123297 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.123203 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf112761-3cea-4f86-bc09-009a2bca78e6-sys\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.130824 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.130803 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfwjf\" (UniqueName: \"kubernetes.io/projected/bf112761-3cea-4f86-bc09-009a2bca78e6-kube-api-access-qfwjf\") pod \"perf-node-gather-daemonset-pw552\" (UID: \"bf112761-3cea-4f86-bc09-009a2bca78e6\") " pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.218770 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.218746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.487325 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.487300 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552"] Sep 15 17:43:49.489251 ip-10-0-143-65 kubenswrapper[2562]: W0915 17:43:49.489222 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbf112761_3cea_4f86_bc09_009a2bca78e6.slice/crio-8fe3bf9d83031891ccce715eb29877406047586358ff352e7b21cd4e5b3ab74f WatchSource:0}: Error finding container 8fe3bf9d83031891ccce715eb29877406047586358ff352e7b21cd4e5b3ab74f: Status 404 returned error can't find the container with id 8fe3bf9d83031891ccce715eb29877406047586358ff352e7b21cd4e5b3ab74f Sep 15 17:43:49.856336 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.856256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" event={"ID":"bf112761-3cea-4f86-bc09-009a2bca78e6","Type":"ContainerStarted","Data":"fa14d20591dbab9ab39d3a3470331528fc61d375157414e7b523ce903cefc185"} Sep 15 17:43:49.856336 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.856308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" event={"ID":"bf112761-3cea-4f86-bc09-009a2bca78e6","Type":"ContainerStarted","Data":"8fe3bf9d83031891ccce715eb29877406047586358ff352e7b21cd4e5b3ab74f"} Sep 15 17:43:49.856514 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.856365 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:49.873001 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:49.872958 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" podStartSLOduration=1.872944238 podStartE2EDuration="1.872944238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:43:49.871562458 +0000 UTC m=+797.629674320" watchObservedRunningTime="2026-09-15 17:43:49.872944238 +0000 UTC m=+797.631056109" Sep 15 17:43:51.305770 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:51.305744 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mlfv9_65bdb16b-3b25-40e1-98a4-c3b408fc4585/dns/0.log" Sep 15 17:43:51.328931 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:51.328907 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mlfv9_65bdb16b-3b25-40e1-98a4-c3b408fc4585/kube-rbac-proxy/0.log" Sep 15 17:43:51.434254 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:51.434227 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6ftln_0c4fa2b3-0406-4f60-9a2e-79c3c2b882a9/dns-node-resolver/0.log" Sep 15 17:43:52.039727 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:52.039695 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hkrrv_be3e6f01-bb44-4ffc-8bd3-03c965953454/node-ca/0.log" Sep 15 17:43:53.045248 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:53.045224 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn_c52566cc-ce02-44c4-b5b8-2636550723b1/istio-proxy/0.log" Sep 15 17:43:53.229866 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:53.229836 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2ds9n_b97bf5f7-a816-44ea-a17a-e7dffd3833ff/istio-proxy/1.log" Sep 15 17:43:53.230277 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:53.230263 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2ds9n_b97bf5f7-a816-44ea-a17a-e7dffd3833ff/istio-proxy/0.log" Sep 15 17:43:53.274141 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:53.274117 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cxnlp_162c74bb-888e-4f15-b443-bfe099ede615/payload-processing/0.log" Sep 15 17:43:53.300290 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:53.300233 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6777464cb4-nw5hb_d3fe5ed1-4f96-4764-9360-ff058cbc91b9/router/0.log" Sep 15 17:43:53.961505 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:53.961480 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wszgt_8bd294ad-7258-4423-b335-7bc32eb366ca/serve-healthcheck-canary/0.log" Sep 15 17:43:54.471407 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:54.471382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jgdc8_8ee3e237-b41f-4c0b-a770-0c2745f24f18/kube-rbac-proxy/0.log" Sep 15 17:43:54.493381 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:54.493356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jgdc8_8ee3e237-b41f-4c0b-a770-0c2745f24f18/exporter/0.log" Sep 15 17:43:54.514315 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:54.514290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jgdc8_8ee3e237-b41f-4c0b-a770-0c2745f24f18/extractor/0.log" Sep 15 17:43:55.870176 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:55.870149 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6l5ln/perf-node-gather-daemonset-pw552" Sep 15 17:43:56.766325 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:56.766298 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cd8dd_b20fea29-1994-44e7-a065-3e4937556041/manager/0.log" Sep 15 17:43:56.793705 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:56.793681 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-475dd_c8cb85bb-a9b1-456c-9141-58b9c5d13bb9/manager/0.log" Sep 15 17:43:56.822042 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:56.822017 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6458bc4d69-wl5r6_700824d9-8759-4f67-b924-52711c140de3/manager/0.log" Sep 15 17:43:56.843095 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:56.843055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x9zmc_06adfeda-5a6a-4801-bcbe-27307847298d/server/0.log" Sep 15 17:43:56.885527 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:56.885503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qvh4x_1c5e58dc-91d5-4444-9f0e-ac8fd23a569c/manager/0.log" Sep 15 17:43:56.973767 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:56.973739 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55876947b7-md4xd_85bf4562-7163-445e-be57-be9889f7deb1/manager/0.log" Sep 15 17:43:56.989836 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:56.989817 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55876947b7-md4xd_85bf4562-7163-445e-be57-be9889f7deb1/copy-manifests/0.log" Sep 15 17:43:58.380236 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:58.380207 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6888d799b5-lkql9_cd3e436d-9916-4165-a961-f24f68a53413/manager/0.log" Sep 15 17:43:58.430757 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:58.430731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wgw8g_d0c9fe52-5819-4a5f-bb86-4092b26f89a2/openshift-lws-operator/0.log" Sep 15 17:43:59.725981 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:59.725955 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn_c52566cc-ce02-44c4-b5b8-2636550723b1/istio-proxy/0.log" Sep 15 17:43:59.806690 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:59.806665 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2ds9n_b97bf5f7-a816-44ea-a17a-e7dffd3833ff/istio-proxy/1.log" Sep 15 17:43:59.807272 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:59.807257 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2ds9n_b97bf5f7-a816-44ea-a17a-e7dffd3833ff/istio-proxy/0.log" Sep 15 17:43:59.829945 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:59.829925 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cxnlp_162c74bb-888e-4f15-b443-bfe099ede615/payload-processing/0.log" Sep 15 17:43:59.848032 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:43:59.848014 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6777464cb4-nw5hb_d3fe5ed1-4f96-4764-9360-ff058cbc91b9/router/0.log" Sep 15 17:44:00.951600 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:00.951568 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lx9mn_c52566cc-ce02-44c4-b5b8-2636550723b1/istio-proxy/0.log" Sep 15 17:44:01.034734 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:01.034707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2ds9n_b97bf5f7-a816-44ea-a17a-e7dffd3833ff/istio-proxy/1.log" Sep 15 17:44:01.035273 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:01.035257 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2ds9n_b97bf5f7-a816-44ea-a17a-e7dffd3833ff/istio-proxy/0.log" Sep 15 17:44:01.061781 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:01.061755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-cxnlp_162c74bb-888e-4f15-b443-bfe099ede615/payload-processing/0.log" Sep 15 17:44:01.082016 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:01.081993 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6777464cb4-nw5hb_d3fe5ed1-4f96-4764-9360-ff058cbc91b9/router/0.log" Sep 15 17:44:05.014205 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.014184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz89h_53bfa278-4cbe-4ba2-89c5-8d45bb954e77/kube-multus-additional-cni-plugins/0.log" Sep 15 17:44:05.035001 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.034978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz89h_53bfa278-4cbe-4ba2-89c5-8d45bb954e77/egress-router-binary-copy/0.log" Sep 15 17:44:05.056265 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.056237 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz89h_53bfa278-4cbe-4ba2-89c5-8d45bb954e77/cni-plugins/0.log" Sep 15 17:44:05.075315 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.075292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz89h_53bfa278-4cbe-4ba2-89c5-8d45bb954e77/bond-cni-plugin/0.log" Sep 15 17:44:05.094589 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.094573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz89h_53bfa278-4cbe-4ba2-89c5-8d45bb954e77/routeoverride-cni/0.log" Sep 15 17:44:05.114503 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.114481 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz89h_53bfa278-4cbe-4ba2-89c5-8d45bb954e77/whereabouts-cni-bincopy/0.log" Sep 15 17:44:05.133596 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.133576 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz89h_53bfa278-4cbe-4ba2-89c5-8d45bb954e77/whereabouts-cni/0.log" Sep 15 17:44:05.351330 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.351265 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jhrht_8f1f02c5-0706-4816-87f7-105c522ad7b8/kube-multus/0.log" Sep 15 17:44:05.446751 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.446729 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9wkp_d94489f1-50e8-4935-a293-149b65aa4c7f/network-metrics-daemon/0.log" Sep 15 17:44:05.465875 ip-10-0-143-65 kubenswrapper[2562]: I0915 17:44:05.465854 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9wkp_d94489f1-50e8-4935-a293-149b65aa4c7f/kube-rbac-proxy/0.log"