Sep 09 17:38:10.971451 ip-10-0-130-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 17:38:10.971467 ip-10-0-130-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 17:38:10.971478 ip-10-0-130-216 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 17:38:10.971822 ip-10-0-130-216 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 17:38:21.107186 ip-10-0-130-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 17:38:21.107205 ip-10-0-130-216 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4e5a4dde90904c08ac4f65880cc1f25d -- Sep 09 17:40:18.116911 ip-10-0-130-216 systemd[1]: Starting Kubernetes Kubelet... Sep 09 17:40:18.471301 ip-10-0-130-216 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 17:40:18.471301 ip-10-0-130-216 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 17:40:18.471301 ip-10-0-130-216 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 17:40:18.471301 ip-10-0-130-216 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 17:40:18.471301 ip-10-0-130-216 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 17:40:18.472106 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.472020 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 17:40:18.478221 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478204 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 17:40:18.478221 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478220 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 17:40:18.478221 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478224 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478228 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478231 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478234 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478239 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478243 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478246 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478250 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478254 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478259 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478262 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478265 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478269 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478272 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478275 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478284 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478287 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478290 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 17:40:18.478317 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478293 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478295 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478298 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478301 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478303 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478306 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478309 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478312 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478314 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478317 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478319 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478322 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478326 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478328 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478331 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478334 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478336 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478339 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478341 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478344 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 17:40:18.478759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478346 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478349 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478351 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478354 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478358 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478360 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478363 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478365 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478368 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478371 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478379 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478382 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478384 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478387 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478390 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478393 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478396 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478398 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478401 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478403 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 17:40:18.479241 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478406 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478408 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478411 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478414 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478416 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478418 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478421 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478424 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478426 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478429 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478431 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478434 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478436 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478439 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478441 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478444 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478446 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478449 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478451 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478454 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 17:40:18.479790 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478457 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478459 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478462 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478470 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478473 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478476 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478479 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478481 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478484 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478486 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478489 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478491 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478494 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478496 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478499 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478501 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478504 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478506 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.478509 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479302 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479310 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 17:40:18.480268 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479313 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479317 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479319 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479322 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479325 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479328 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479331 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479334 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479336 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479339 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479342 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479344 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479347 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479350 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479353 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479362 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479365 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479368 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479371 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479374 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 17:40:18.480796 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479376 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479379 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479381 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479384 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479386 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479389 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479391 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479394 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479396 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479399 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479401 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479403 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479406 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479408 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479411 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479413 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479416 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479418 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479421 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479423 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 17:40:18.481287 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479425 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479429 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479432 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479435 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479437 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479440 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479443 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479445 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479454 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479457 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479460 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479463 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479465 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479468 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479470 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479473 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479475 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479478 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479480 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 17:40:18.481784 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479483 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479485 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479488 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479492 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479495 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479498 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479501 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479504 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479507 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479510 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479512 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479520 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479524 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479527 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479530 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479533 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479535 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479538 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479541 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 17:40:18.482254 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479544 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479547 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479549 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479560 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479563 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479565 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479568 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479571 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479575 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479578 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479581 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479583 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479586 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479588 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479591 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479593 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479595 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479598 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.479600 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480078 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 17:40:18.482740 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480083 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480086 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480088 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480091 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480095 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480101 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480104 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480107 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480110 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480113 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480116 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480119 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480122 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480125 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480128 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480138 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480141 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480143 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480146 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480148 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 17:40:18.483242 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480151 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480155 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480159 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480162 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480165 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480168 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480171 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480173 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480176 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480179 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480181 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480184 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480187 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480190 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480193 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480196 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480198 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480203 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480206 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 17:40:18.483746 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480209 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480211 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480213 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480218 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480220 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480222 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480225 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480228 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480230 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480240 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480242 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480245 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480247 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480250 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480254 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480256 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480259 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480261 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480265 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480268 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 17:40:18.484206 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480270 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480273 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480276 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480278 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480281 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480284 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480286 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480289 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480291 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480294 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480297 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480299 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480301 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480304 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480307 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480312 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480315 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480317 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480320 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 17:40:18.484747 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480322 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480325 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480328 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480336 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480339 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480342 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480344 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480347 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480349 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480352 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480354 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480357 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480359 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480362 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480364 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480366 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480369 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480372 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480374 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.480376 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 17:40:18.485208 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480456 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480500 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480510 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480515 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480519 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480522 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480526 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480530 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480535 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480538 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480541 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480544 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480549 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480551 2561 flags.go:64] FLAG: --cgroup-root="" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480554 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480557 2561 flags.go:64] FLAG: --client-ca-file="" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480566 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480569 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480575 2561 flags.go:64] FLAG: --cluster-domain="" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480578 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480581 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480584 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480587 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480591 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 17:40:18.485693 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480594 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480597 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480600 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480609 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480612 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480614 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480629 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480632 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480636 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480639 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480642 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480645 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480648 2561 flags.go:64] FLAG: --enable-server="true" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480651 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480658 2561 flags.go:64] FLAG: --event-burst="100" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480661 2561 flags.go:64] FLAG: --event-qps="50" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480665 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480668 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480671 2561 flags.go:64] FLAG: --eviction-hard="" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480675 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480677 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480681 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480683 2561 flags.go:64] FLAG: --eviction-soft="" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480686 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480689 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 17:40:18.486373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480697 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480700 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480703 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480706 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480709 2561 flags.go:64] FLAG: --feature-gates="" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480713 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480715 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480718 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480721 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480724 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480728 2561 flags.go:64] FLAG: --help="false" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480731 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480733 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480736 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480739 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480742 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480746 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480749 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480751 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480754 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480757 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480760 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480763 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480767 2561 flags.go:64] FLAG: --kube-reserved="" Sep 09 17:40:18.487055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480769 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480772 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480775 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480778 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480781 2561 flags.go:64] FLAG: --lock-file="" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480784 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480787 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480789 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480795 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480804 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480807 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480810 2561 flags.go:64] FLAG: --logging-format="text" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480813 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480816 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480819 2561 flags.go:64] FLAG: --manifest-url="" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480822 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480826 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480829 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480838 2561 flags.go:64] FLAG: --max-pods="110" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480841 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480844 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480847 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480850 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480853 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480855 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 17:40:18.487869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480858 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480866 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480869 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480872 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480875 2561 flags.go:64] FLAG: --pod-cidr="" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480877 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480883 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480886 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480890 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480892 2561 flags.go:64] FLAG: --port="10250" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480895 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480898 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cf596180d839d446" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480901 2561 flags.go:64] FLAG: --qos-reserved="" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480904 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480906 2561 flags.go:64] FLAG: --register-node="true" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480909 2561 flags.go:64] FLAG: --register-with-taints="" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480916 2561 flags.go:64] FLAG: --registry-burst="10" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480926 2561 flags.go:64] FLAG: --registry-qps="5" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480929 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480932 2561 flags.go:64] FLAG: --reserved-memory="" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480936 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480938 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480941 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480944 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480947 2561 flags.go:64] FLAG: --runonce="false" Sep 09 17:40:18.488796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480949 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480952 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480955 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480958 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480960 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480963 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480966 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480969 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480976 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480979 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480981 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480984 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480987 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480990 2561 flags.go:64] FLAG: --system-cgroups="" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480993 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.480998 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481001 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481003 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481010 2561 flags.go:64] FLAG: --tls-min-version="" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481013 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481016 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481018 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481021 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481024 2561 flags.go:64] FLAG: --v="2" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481028 2561 flags.go:64] FLAG: --version="false" Sep 09 17:40:18.489407 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481037 2561 flags.go:64] FLAG: --vmodule="" Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481041 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481044 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481191 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481194 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481197 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481199 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481202 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481204 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481207 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481210 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481212 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481215 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481217 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481220 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481224 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481226 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481229 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481232 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481234 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 17:40:18.490032 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481237 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481240 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481242 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481245 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481247 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481250 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481252 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481255 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481257 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481260 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481262 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481264 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481267 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481275 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481278 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481280 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481283 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481285 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481288 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 17:40:18.490524 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481291 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481293 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481296 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481298 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481301 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481303 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481306 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481308 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481312 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481314 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481317 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481320 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481322 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481325 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481327 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481330 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481332 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481335 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481337 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481340 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 17:40:18.491011 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481342 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481345 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481347 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481350 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481352 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481354 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481357 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481365 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481367 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481370 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481374 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481378 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481381 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481384 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481387 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481390 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481392 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481395 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481397 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 17:40:18.491505 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481401 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481406 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481409 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481412 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481415 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481418 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481420 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481423 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481425 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481428 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481430 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481433 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481435 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481438 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481440 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481443 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481446 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481448 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481450 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481453 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 17:40:18.491981 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481456 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481463 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481466 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.481469 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.481474 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.490655 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.490673 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.491417 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.491425 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491500 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491505 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491509 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491512 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491515 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 17:40:18.492507 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491519 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491523 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491527 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491530 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491533 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491536 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491538 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491541 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491544 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491546 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491550 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491552 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491555 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491558 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491560 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491563 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491565 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491568 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491571 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491573 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 17:40:18.492879 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491576 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491579 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491582 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491585 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491589 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491593 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491597 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491601 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491605 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491609 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491612 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491615 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491630 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491634 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491637 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491640 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491643 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491646 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491649 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491651 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 17:40:18.493360 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491654 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491657 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491660 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491663 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491665 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491668 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491671 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491673 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491676 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491678 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491681 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491684 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491687 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491691 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491694 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491697 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491700 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491703 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491706 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 17:40:18.493854 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491709 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491712 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491715 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491718 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491721 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491724 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491726 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491729 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491732 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491734 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491737 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491739 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491742 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491745 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491747 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491750 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491753 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491756 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491758 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491761 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 17:40:18.494327 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491763 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491766 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491769 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491771 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491774 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491777 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491779 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491782 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491785 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491787 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491790 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491792 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491795 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491798 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491800 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 17:40:18.494946 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.491805 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491927 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491932 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491935 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491937 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491940 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491943 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491946 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491948 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491951 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491954 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491957 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491959 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491963 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491966 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491969 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491971 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491974 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491979 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491986 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 17:40:18.495319 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491990 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491993 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491996 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.491999 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492002 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492005 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492007 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492010 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492012 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492017 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492020 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492023 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492026 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492029 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492032 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492035 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492038 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492040 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492043 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 17:40:18.495832 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492046 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492048 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492051 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492054 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492056 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492059 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492061 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492065 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492068 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492071 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492073 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492076 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492079 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492081 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492084 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492087 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492089 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492092 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492094 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 17:40:18.496289 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492097 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492099 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492102 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492104 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492107 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492109 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492112 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492114 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492116 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492119 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492122 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492124 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492127 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492130 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492132 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492135 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492137 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492140 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492142 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492145 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 17:40:18.496774 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492147 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492150 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492154 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492157 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492160 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492162 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492165 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492167 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492170 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492173 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492175 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492178 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492180 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492183 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492185 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492188 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492190 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492193 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492195 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 17:40:18.497255 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492198 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492200 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:18.492203 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.492208 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.492347 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.495497 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.496306 2561 server.go:1019] "Starting client certificate rotation" Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.496402 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 17:40:18.497764 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.496440 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 17:40:18.498707 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.498687 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 17:40:18.500755 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.500733 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 17:40:18.509758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.509742 2561 log.go:25] "Validated CRI v1 runtime API" Sep 09 17:40:18.512488 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.512475 2561 log.go:25] "Validated CRI v1 image API" Sep 09 17:40:18.513397 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.513383 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 17:40:18.515570 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.515550 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8793e497-5a66-473a-b53d-2d3fa635491c:/dev/nvme0n1p4 e0b14cb5-bea4-4752-a05a-50e2cdac8b3d:/dev/nvme0n1p3] Sep 09 17:40:18.515660 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.515567 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 17:40:18.521910 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.521786 2561 manager.go:216] Machine: {Timestamp:2026-09-09 17:40:18.520124202 +0000 UTC m=+0.298400578 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093464 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20e4383c081e5e28f63f4b738e1f0c SystemUUID:ec20e438-3c08-1e5e-28f6-3f4b738e1f0c BootID:4e5a4dde-9090-4c08-ac4f-65880cc1f25d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:40:93:9a:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:40:93:9a:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:af:0f:82:df:25 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 17:40:18.521910 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.521899 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 17:40:18.522053 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.521993 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 17:40:18.525511 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.525488 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 17:40:18.525661 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.525514 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 17:40:18.526888 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.526877 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 17:40:18.526921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.526891 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 17:40:18.526921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.526899 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 17:40:18.526921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.526913 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 17:40:18.528249 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.528239 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 17:40:18.531649 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.531637 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 09 17:40:18.531766 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.531758 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 17:40:18.531795 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.531785 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 09 17:40:18.531795 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.531793 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 17:40:18.531856 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.531805 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 17:40:18.531856 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.531814 2561 kubelet.go:398] "Adding apiserver pod source" Sep 09 17:40:18.531856 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.531822 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 17:40:18.532209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.532195 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 17:40:18.532261 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.532219 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 17:40:18.533199 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.533180 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 17:40:18.534802 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.534784 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 17:40:18.537087 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537074 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 17:40:18.537127 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537104 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 17:40:18.537252 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537243 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 17:40:18.537285 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537257 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 17:40:18.537285 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537263 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 17:40:18.537285 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537268 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 17:40:18.537285 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537276 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 17:40:18.537285 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537282 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 17:40:18.537862 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537838 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 17:40:18.537862 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537848 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 17:40:18.537862 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537855 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 17:40:18.537862 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537860 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 17:40:18.537993 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537869 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 17:40:18.537993 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.537878 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 17:40:18.539739 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.539726 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 17:40:18.539739 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.539737 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 17:40:18.540761 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.540733 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 17:40:18.540761 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.540734 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 17:40:18.543565 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.543553 2561 server.go:1268] "Started kubelet" Sep 09 17:40:18.543744 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.543637 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 17:40:18.544320 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.544292 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 17:40:18.544501 ip-10-0-130-216 systemd[1]: Started Kubernetes Kubelet. Sep 09 17:40:18.544712 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.544605 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 17:40:18.544712 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.544689 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 17:40:18.545873 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.545852 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 09 17:40:18.545956 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.545855 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 17:40:18.549664 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.549648 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 17:40:18.549938 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.549915 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 17:40:18.550342 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.550322 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 17:40:18.550430 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.550419 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:18.550974 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.550959 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 17:40:18.550974 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.550976 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 17:40:18.551133 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.550962 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 17:40:18.551133 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551056 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 09 17:40:18.551133 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551064 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 09 17:40:18.551133 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551104 2561 factory.go:55] Registering systemd factory Sep 09 17:40:18.551133 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551118 2561 factory.go:223] Registration of the systemd container factory successfully Sep 09 17:40:18.551367 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551352 2561 factory.go:153] Registering CRI-O factory Sep 09 17:40:18.551424 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551370 2561 factory.go:223] Registration of the crio container factory successfully Sep 09 17:40:18.551424 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551416 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 17:40:18.551486 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551435 2561 factory.go:103] Registering Raw factory Sep 09 17:40:18.551486 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551451 2561 manager.go:1196] Started watching for new ooms in manager Sep 09 17:40:18.551896 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.551883 2561 manager.go:349] Starting recovery of all containers Sep 09 17:40:18.552017 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.551094 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-216.ec2.internal.18d3b7d8bf1f1f5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-216.ec2.internal,UID:ip-10-0-130-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-216.ec2.internal,},FirstTimestamp:2026-09-09 17:40:18.543525725 +0000 UTC m=+0.321802098,LastTimestamp:2026-09-09 17:40:18.543525725 +0000 UTC m=+0.321802098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-216.ec2.internal,}" Sep 09 17:40:18.555696 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.555668 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 17:40:18.555779 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.555709 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 17:40:18.563385 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.562309 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnbh9" Sep 09 17:40:18.563385 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.562964 2561 manager.go:354] Recovery completed Sep 09 17:40:18.567743 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.567556 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 17:40:18.568155 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.568138 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnbh9" Sep 09 17:40:18.570303 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.570284 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientMemory" Sep 09 17:40:18.570368 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.570322 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 17:40:18.570368 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.570337 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientPID" Sep 09 17:40:18.571309 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.571296 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 17:40:18.571367 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.571310 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 17:40:18.571367 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.571327 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 09 17:40:18.571459 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.571298 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 17:40:18.572175 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.572135 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientMemory" Sep 09 17:40:18.572175 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.572164 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 17:40:18.572283 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.572178 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientPID" Sep 09 17:40:18.572453 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.572359 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-216.ec2.internal.18d3b7d8c0b7b6da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-216.ec2.internal,UID:ip-10-0-130-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-216.ec2.internal,},FirstTimestamp:2026-09-09 17:40:18.570303194 +0000 UTC m=+0.348579578,LastTimestamp:2026-09-09 17:40:18.570303194 +0000 UTC m=+0.348579578,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-216.ec2.internal,}" Sep 09 17:40:18.572543 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.572509 2561 policy_none.go:49] "None policy: Start" Sep 09 17:40:18.572543 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.572528 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 17:40:18.572543 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.572541 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 17:40:18.573677 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.573663 2561 policy_none.go:47] "Start" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.601539 2561 manager.go:337] "Starting Device Plugin manager" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.601577 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.601587 2561 server.go:87] "Starting device plugin registration server" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.601932 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.601946 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.602047 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.602106 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.602112 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.602655 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 17:40:18.616917 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.602704 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:18.685835 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.685793 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 17:40:18.687010 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.686985 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 17:40:18.687092 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.687038 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 17:40:18.687092 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.687064 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 17:40:18.687185 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.687159 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 17:40:18.689504 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.689487 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 17:40:18.702670 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.702654 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 17:40:18.703550 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.703535 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientMemory" Sep 09 17:40:18.703657 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.703569 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 17:40:18.703657 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.703585 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientPID" Sep 09 17:40:18.703657 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.703617 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.711898 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.711882 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.711968 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.711903 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-216.ec2.internal\": node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:18.735123 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.735050 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:18.788126 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.788102 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal"] Sep 09 17:40:18.788228 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.788195 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 17:40:18.789111 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.789095 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientMemory" Sep 09 17:40:18.789206 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.789128 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 17:40:18.789206 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.789142 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientPID" Sep 09 17:40:18.790405 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.790390 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 17:40:18.790513 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.790500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.790562 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.790528 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 17:40:18.791149 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.791118 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientMemory" Sep 09 17:40:18.791149 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.791148 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 17:40:18.791263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.791157 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientPID" Sep 09 17:40:18.791263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.791125 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientMemory" Sep 09 17:40:18.791263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.791222 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 17:40:18.791263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.791255 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientPID" Sep 09 17:40:18.792523 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.792510 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.792571 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.792532 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 17:40:18.793250 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.793236 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientMemory" Sep 09 17:40:18.793326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.793255 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 17:40:18.793326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.793264 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeHasSufficientPID" Sep 09 17:40:18.826337 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.826307 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-216.ec2.internal\" not found" node="ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.830904 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.830888 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-216.ec2.internal\" not found" node="ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.835932 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.835919 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:18.852828 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.852801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/355b170cb2bd0f1c678699fb0400a4e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal\" (UID: \"355b170cb2bd0f1c678699fb0400a4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.852884 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.852833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/355b170cb2bd0f1c678699fb0400a4e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal\" (UID: \"355b170cb2bd0f1c678699fb0400a4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.852884 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.852855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b6497d2a1dab0e32472faf9c39d7ed3-config\") pod \"kube-apiserver-proxy-ip-10-0-130-216.ec2.internal\" (UID: \"1b6497d2a1dab0e32472faf9c39d7ed3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.936551 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:18.936521 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:18.953865 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.953842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b6497d2a1dab0e32472faf9c39d7ed3-config\") pod \"kube-apiserver-proxy-ip-10-0-130-216.ec2.internal\" (UID: \"1b6497d2a1dab0e32472faf9c39d7ed3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.953921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.953869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/355b170cb2bd0f1c678699fb0400a4e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal\" (UID: \"355b170cb2bd0f1c678699fb0400a4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.953921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.953887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/355b170cb2bd0f1c678699fb0400a4e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal\" (UID: \"355b170cb2bd0f1c678699fb0400a4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.953992 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.953957 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/355b170cb2bd0f1c678699fb0400a4e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal\" (UID: \"355b170cb2bd0f1c678699fb0400a4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.953992 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.953967 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/355b170cb2bd0f1c678699fb0400a4e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal\" (UID: \"355b170cb2bd0f1c678699fb0400a4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:18.954061 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:18.953967 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b6497d2a1dab0e32472faf9c39d7ed3-config\") pod \"kube-apiserver-proxy-ip-10-0-130-216.ec2.internal\" (UID: \"1b6497d2a1dab0e32472faf9c39d7ed3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" Sep 09 17:40:19.037325 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:19.037255 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:19.128727 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:19.128682 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:19.133755 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:19.133736 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" Sep 09 17:40:19.138360 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:19.138342 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:19.238821 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:19.238783 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:20.468670 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:20.468644 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:20.569272 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:20.569242 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:20.625718 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.625689 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 17:40:20.626165 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.625849 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 17:40:20.670208 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:20.670176 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:20.700246 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.700170 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 17:35:19 +0000 UTC" deadline="2028-03-23 15:08:32.618159562 +0000 UTC" Sep 09 17:40:20.700246 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.700200 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13461h28m11.917962322s" Sep 09 17:40:20.770511 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:20.770478 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-216.ec2.internal\" not found" Sep 09 17:40:20.820934 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:20.820906 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355b170cb2bd0f1c678699fb0400a4e0.slice/crio-0f85b096f2ad72298efab15fd4226e7861a6ecd816564f19adfccc35cfdc9b8b WatchSource:0}: Error finding container 0f85b096f2ad72298efab15fd4226e7861a6ecd816564f19adfccc35cfdc9b8b: Status 404 returned error can't find the container with id 0f85b096f2ad72298efab15fd4226e7861a6ecd816564f19adfccc35cfdc9b8b Sep 09 17:40:20.821394 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:20.821372 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6497d2a1dab0e32472faf9c39d7ed3.slice/crio-e745027262ed4d29edb4d6de4878ef2d10b3f57d11e03492b3e13a01165e9bc4 WatchSource:0}: Error finding container e745027262ed4d29edb4d6de4878ef2d10b3f57d11e03492b3e13a01165e9bc4: Status 404 returned error can't find the container with id e745027262ed4d29edb4d6de4878ef2d10b3f57d11e03492b3e13a01165e9bc4 Sep 09 17:40:20.825555 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.825533 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 17:40:20.843102 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.843081 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 17:40:20.880539 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.880516 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" Sep 09 17:40:20.885075 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.885057 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 17:40:20.890680 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.890667 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 17:40:20.891470 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.891456 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" Sep 09 17:40:20.901601 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:20.901585 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 17:40:21.233835 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.233808 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 17:40:21.663068 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.662997 2561 apiserver.go:52] "Watching apiserver" Sep 09 17:40:21.668245 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.668220 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 17:40:21.668651 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.668628 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qmqql","openshift-network-diagnostics/network-check-target-rmgb6","openshift-network-operator/iptables-alerter-7rr4p","kube-system/konnectivity-agent-qbc6q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h","openshift-dns/node-resolver-mgrxr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal","openshift-multus/multus-additional-cni-plugins-cp64t","openshift-multus/network-metrics-daemon-9c82n","openshift-ovn-kubernetes/ovnkube-node-6qzgs","kube-system/global-pull-secret-syncer-l8gf9","kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z9zjs","openshift-image-registry/node-ca-7hb6c"] Sep 09 17:40:21.670440 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.670419 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.671856 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.671833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.672225 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.672197 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p64lf\"" Sep 09 17:40:21.672327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.672295 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 17:40:21.672444 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.672396 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 17:40:21.673874 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.673476 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.673874 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.673558 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hfdc4\"" Sep 09 17:40:21.673874 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.673563 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 17:40:21.673874 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.673853 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 17:40:21.674139 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.673882 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.675200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.676022 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.676286 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.676569 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.676832 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-67jtz\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.677079 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.677102 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.677390 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.677426 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.677388 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fxmzg\"" Sep 09 17:40:21.678489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.677575 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.679104 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.678672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.679167 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.679123 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 17:40:21.679726 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.679304 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 17:40:21.679726 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.679325 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 17:40:21.679726 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.679688 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-97ptf\"" Sep 09 17:40:21.680364 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.680326 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 17:40:21.680872 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.680333 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 17:40:21.681269 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.681252 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gbmp7\"" Sep 09 17:40:21.681498 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.681481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.683173 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.683153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:21.683264 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.683218 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-82nqk\"" Sep 09 17:40:21.683264 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.683226 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:21.683386 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.683348 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 17:40:21.683512 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.683494 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 17:40:21.683512 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.683508 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 17:40:21.684784 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.684766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.686565 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.686549 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.686653 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.686608 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:21.686797 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.686781 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 17:40:21.687289 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.687270 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 17:40:21.687500 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.687482 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 17:40:21.687571 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.687552 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-76gb6\"" Sep 09 17:40:21.687673 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.687658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 17:40:21.687765 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.687749 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 17:40:21.687823 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.687807 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 17:40:21.687910 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.687892 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.689489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689470 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:21.689577 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.689533 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:21.689721 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689706 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 17:40:21.689778 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-sys-fs\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.689835 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689787 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktstv\" (UniqueName: \"kubernetes.io/projected/e489c1e7-7d01-48bc-bbb7-0100bd77706a-kube-api-access-ktstv\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.689835 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-system-cni-dir\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.689926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.689926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jhs\" (UniqueName: \"kubernetes.io/projected/d9c17deb-7f67-40b9-93e8-357024b178f4-kube-api-access-98jhs\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.689926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-kubelet\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.689926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm5n5\" (UniqueName: \"kubernetes.io/projected/561c0770-1a7a-4caf-a8d5-947681590769-kube-api-access-dm5n5\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.689965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9c17deb-7f67-40b9-93e8-357024b178f4-cni-binary-copy\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690005 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-cni-multus\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690029 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fplf5\"" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrq67\" (UniqueName: \"kubernetes.io/projected/54ef575f-4452-4af6-8ca7-abc5806b4d78-kube-api-access-lrq67\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690025 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-cnibin\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-cni-bin\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-multus-certs\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-system-cni-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-daemon-config\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690189 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ef575f-4452-4af6-8ca7-abc5806b4d78-host-slash\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbf6216f-f80d-48a6-944a-f96835051e16-hosts-file\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf6216f-f80d-48a6-944a-f96835051e16-tmp-dir\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-socket-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-device-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-k8s-cni-cncf-io\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-netns\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-conf-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfqt9\" (UniqueName: \"kubernetes.io/projected/fbf6216f-f80d-48a6-944a-f96835051e16-kube-api-access-wfqt9\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a87bee1a-d630-4591-a4b2-b2513f15b65b-konnectivity-ca\") pod \"konnectivity-agent-qbc6q\" (UID: \"a87bee1a-d630-4591-a4b2-b2513f15b65b\") " pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vks5c\" (UniqueName: \"kubernetes.io/projected/afd1ae53-ad9e-4894-a132-2a315fbea789-kube-api-access-vks5c\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-cni-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.690536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-cnibin\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-socket-dir-parent\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-hostroot\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-etc-kubernetes\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a87bee1a-d630-4591-a4b2-b2513f15b65b-agent-certs\") pod \"konnectivity-agent-qbc6q\" (UID: \"a87bee1a-d630-4591-a4b2-b2513f15b65b\") " pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e489c1e7-7d01-48bc-bbb7-0100bd77706a-host\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e489c1e7-7d01-48bc-bbb7-0100bd77706a-serviceca\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54ef575f-4452-4af6-8ca7-abc5806b4d78-iptables-alerter-script\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-registration-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.691354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.690773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-etc-selinux\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.693242 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.693220 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 17:40:21.701492 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.701476 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 17:40:21.715520 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.715496 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qdvc" Sep 09 17:40:21.723045 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.723029 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qdvc" Sep 09 17:40:21.781454 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.781424 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 17:40:21.791125 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d86b33-a0cf-462c-b284-e1672e2c7639-kubelet-config\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.791265 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysctl-d\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.791265 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-ovn\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.791360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.791404 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-k8s-cni-cncf-io\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791404 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-netns\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791501 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-conf-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791501 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfqt9\" (UniqueName: \"kubernetes.io/projected/fbf6216f-f80d-48a6-944a-f96835051e16-kube-api-access-wfqt9\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.791501 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-var-lib-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.791501 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-k8s-cni-cncf-io\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791501 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovnkube-script-lib\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.791723 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.791723 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-conf-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791723 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vks5c\" (UniqueName: \"kubernetes.io/projected/afd1ae53-ad9e-4894-a132-2a315fbea789-kube-api-access-vks5c\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.791723 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-cni-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791723 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-hostroot\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791757 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-cni-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791506 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-netns\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-etc-kubernetes\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791828 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-hostroot\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-etc-selinux\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791833 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-etc-kubernetes\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-systemd-units\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-systemd\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791908 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-etc-selinux\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54ef575f-4452-4af6-8ca7-abc5806b4d78-iptables-alerter-script\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.791968 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-etc-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.791981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfwh2\" (UniqueName: \"kubernetes.io/projected/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-kube-api-access-dfwh2\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p4mk\" (UniqueName: \"kubernetes.io/projected/7d811657-ec09-4670-a288-cff11495d583-kube-api-access-7p4mk\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d86b33-a0cf-462c-b284-e1672e2c7639-dbus\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysconfig\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jhs\" (UniqueName: \"kubernetes.io/projected/d9c17deb-7f67-40b9-93e8-357024b178f4-kube-api-access-98jhs\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa5147a2-6d00-4fa1-be5a-650ddac89357-tmp\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slkzs\" (UniqueName: \"kubernetes.io/projected/aa5147a2-6d00-4fa1-be5a-650ddac89357-kube-api-access-slkzs\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-kubelet\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-log-socket\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.792474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovnkube-config\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-var-lib-kubelet\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792544 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54ef575f-4452-4af6-8ca7-abc5806b4d78-iptables-alerter-script\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9c17deb-7f67-40b9-93e8-357024b178f4-cni-binary-copy\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrq67\" (UniqueName: \"kubernetes.io/projected/54ef575f-4452-4af6-8ca7-abc5806b4d78-kube-api-access-lrq67\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-node-log\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-cni-netd\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792723 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-cnibin\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-cnibin\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-multus-certs\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792909 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-run-multus-certs\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.792926 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovn-node-metrics-cert\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-tuned\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.792989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-system-cni-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-daemon-config\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ef575f-4452-4af6-8ca7-abc5806b4d78-host-slash\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbf6216f-f80d-48a6-944a-f96835051e16-hosts-file\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793145 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9c17deb-7f67-40b9-93e8-357024b178f4-cni-binary-copy\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793157 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ef575f-4452-4af6-8ca7-abc5806b4d78-host-slash\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793160 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-socket-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793171 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793145 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793192 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-system-cni-dir\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793199 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbf6216f-f80d-48a6-944a-f96835051e16-hosts-file\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-device-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793259 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-run-netns\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793280 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-socket-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.793548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a87bee1a-d630-4591-a4b2-b2513f15b65b-konnectivity-ca\") pod \"konnectivity-agent-qbc6q\" (UID: \"a87bee1a-d630-4591-a4b2-b2513f15b65b\") " pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-run\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-host\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-cnibin\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793435 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-device-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-socket-dir-parent\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a87bee1a-d630-4591-a4b2-b2513f15b65b-agent-certs\") pod \"konnectivity-agent-qbc6q\" (UID: \"a87bee1a-d630-4591-a4b2-b2513f15b65b\") " pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-cnibin\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-sys-fs\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793540 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-socket-dir-parent\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm5n5\" (UniqueName: \"kubernetes.io/projected/561c0770-1a7a-4caf-a8d5-947681590769-kube-api-access-dm5n5\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793577 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793596 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-sys-fs\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-slash\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793611 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9c17deb-7f67-40b9-93e8-357024b178f4-multus-daemon-config\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.794327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e489c1e7-7d01-48bc-bbb7-0100bd77706a-host\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793671 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e489c1e7-7d01-48bc-bbb7-0100bd77706a-host\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e489c1e7-7d01-48bc-bbb7-0100bd77706a-serviceca\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-registration-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-modprobe-d\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-kubernetes\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktstv\" (UniqueName: \"kubernetes.io/projected/e489c1e7-7d01-48bc-bbb7-0100bd77706a-kube-api-access-ktstv\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793804 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/561c0770-1a7a-4caf-a8d5-947681590769-registration-dir\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793784 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a87bee1a-d630-4591-a4b2-b2513f15b65b-konnectivity-ca\") pod \"konnectivity-agent-qbc6q\" (UID: \"a87bee1a-d630-4591-a4b2-b2513f15b65b\") " pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-system-cni-dir\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793879 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afd1ae53-ad9e-4894-a132-2a315fbea789-system-cni-dir\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.793995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-env-overrides\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-sys\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-kubelet\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-cni-multus\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.795073 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794168 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-kubelet\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794177 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e489c1e7-7d01-48bc-bbb7-0100bd77706a-serviceca\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-systemd\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794211 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-cni-multus\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-lib-modules\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-cni-bin\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794287 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794288 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9c17deb-7f67-40b9-93e8-357024b178f4-host-var-lib-cni-bin\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-cni-bin\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afd1ae53-ad9e-4894-a132-2a315fbea789-cni-binary-copy\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794377 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysctl-conf\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.794394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf6216f-f80d-48a6-944a-f96835051e16-tmp-dir\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.795713 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.795116 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf6216f-f80d-48a6-944a-f96835051e16-tmp-dir\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.798224 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.798201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a87bee1a-d630-4591-a4b2-b2513f15b65b-agent-certs\") pod \"konnectivity-agent-qbc6q\" (UID: \"a87bee1a-d630-4591-a4b2-b2513f15b65b\") " pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:21.800137 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.800096 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrq67\" (UniqueName: \"kubernetes.io/projected/54ef575f-4452-4af6-8ca7-abc5806b4d78-kube-api-access-lrq67\") pod \"iptables-alerter-7rr4p\" (UID: \"54ef575f-4452-4af6-8ca7-abc5806b4d78\") " pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:21.800613 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.800546 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vks5c\" (UniqueName: \"kubernetes.io/projected/afd1ae53-ad9e-4894-a132-2a315fbea789-kube-api-access-vks5c\") pod \"multus-additional-cni-plugins-cp64t\" (UID: \"afd1ae53-ad9e-4894-a132-2a315fbea789\") " pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:21.800613 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.800561 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfqt9\" (UniqueName: \"kubernetes.io/projected/fbf6216f-f80d-48a6-944a-f96835051e16-kube-api-access-wfqt9\") pod \"node-resolver-mgrxr\" (UID: \"fbf6216f-f80d-48a6-944a-f96835051e16\") " pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.800986 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.800949 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jhs\" (UniqueName: \"kubernetes.io/projected/d9c17deb-7f67-40b9-93e8-357024b178f4-kube-api-access-98jhs\") pod \"multus-qmqql\" (UID: \"d9c17deb-7f67-40b9-93e8-357024b178f4\") " pod="openshift-multus/multus-qmqql" Sep 09 17:40:21.801421 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.801402 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm5n5\" (UniqueName: \"kubernetes.io/projected/561c0770-1a7a-4caf-a8d5-947681590769-kube-api-access-dm5n5\") pod \"aws-ebs-csi-driver-node-bc69h\" (UID: \"561c0770-1a7a-4caf-a8d5-947681590769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:21.802182 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.802164 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktstv\" (UniqueName: \"kubernetes.io/projected/e489c1e7-7d01-48bc-bbb7-0100bd77706a-kube-api-access-ktstv\") pod \"node-ca-7hb6c\" (UID: \"e489c1e7-7d01-48bc-bbb7-0100bd77706a\") " pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.820757 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.820717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" event={"ID":"1b6497d2a1dab0e32472faf9c39d7ed3","Type":"ContainerStarted","Data":"e745027262ed4d29edb4d6de4878ef2d10b3f57d11e03492b3e13a01165e9bc4"} Sep 09 17:40:21.821683 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.821665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" event={"ID":"355b170cb2bd0f1c678699fb0400a4e0","Type":"ContainerStarted","Data":"0f85b096f2ad72298efab15fd4226e7861a6ecd816564f19adfccc35cfdc9b8b"} Sep 09 17:40:21.895133 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-ovn\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895207 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-ovn\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-var-lib-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovnkube-script-lib\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895265 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-var-lib-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895194 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-systemd-units\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-systemd\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-etc-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfwh2\" (UniqueName: \"kubernetes.io/projected/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-kube-api-access-dfwh2\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895379 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-systemd-units\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895402 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-systemd\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p4mk\" (UniqueName: \"kubernetes.io/projected/7d811657-ec09-4670-a288-cff11495d583-kube-api-access-7p4mk\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d86b33-a0cf-462c-b284-e1672e2c7639-dbus\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895447 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-etc-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysconfig\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895525 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysconfig\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895533 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d86b33-a0cf-462c-b284-e1672e2c7639-dbus\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa5147a2-6d00-4fa1-be5a-650ddac89357-tmp\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slkzs\" (UniqueName: \"kubernetes.io/projected/aa5147a2-6d00-4fa1-be5a-650ddac89357-kube-api-access-slkzs\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-kubelet\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.895633 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-log-socket\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.895659 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovnkube-config\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-var-lib-kubelet\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-node-log\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895721 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-kubelet\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-cni-netd\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895764 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-cni-netd\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovn-node-metrics-cert\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-tuned\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.895844 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-run-netns\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895859 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovnkube-script-lib\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.895914 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs podName:7d811657-ec09-4670-a288-cff11495d583 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:22.395875259 +0000 UTC m=+3.044818067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs") pod "network-metrics-daemon-9c82n" (UID: "7d811657-ec09-4670-a288-cff11495d583") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895925 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-run-netns\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.896393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.895945 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-var-lib-kubelet\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.895981 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret podName:50d86b33-a0cf-462c-b284-e1672e2c7639 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:22.395969736 +0000 UTC m=+3.044912547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret") pod "global-pull-secret-syncer-l8gf9" (UID: "50d86b33-a0cf-462c-b284-e1672e2c7639") : object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-run\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896016 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-run-openvswitch\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-host\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-slash\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-modprobe-d\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896098 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-node-log\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-kubernetes\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896136 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-slash\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-env-overrides\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896179 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-host\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-sys\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-systemd\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896228 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-kubernetes\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-run\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.897209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-lib-modules\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-cni-bin\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896322 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovnkube-config\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896336 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-modprobe-d\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysctl-conf\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896349 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-sys\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d86b33-a0cf-462c-b284-e1672e2c7639-kubelet-config\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896401 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-log-socket\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysctl-d\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896447 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysctl-conf\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896464 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d86b33-a0cf-462c-b284-e1672e2c7639-kubelet-config\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896485 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-cni-bin\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896524 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-systemd\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896559 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-lib-modules\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896733 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-env-overrides\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.898043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.896806 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-sysctl-d\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898855 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.898457 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa5147a2-6d00-4fa1-be5a-650ddac89357-etc-tuned\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.898855 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.898532 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa5147a2-6d00-4fa1-be5a-650ddac89357-tmp\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.899494 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.899453 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-ovn-node-metrics-cert\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.902358 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.902337 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 17:40:21.902476 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.902363 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 17:40:21.902476 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.902378 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4lw7f for pod openshift-network-diagnostics/network-check-target-rmgb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:21.902476 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:21.902460 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f podName:e138a63d-f237-4951-9956-f1bde324298e nodeName:}" failed. No retries permitted until 2026-09-09 17:40:22.402444973 +0000 UTC m=+3.051387767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4lw7f" (UniqueName: "kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f") pod "network-check-target-rmgb6" (UID: "e138a63d-f237-4951-9956-f1bde324298e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:21.905060 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.904987 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfwh2\" (UniqueName: \"kubernetes.io/projected/9564eb5a-61ba-4bc5-926d-9e3ebc86096a-kube-api-access-dfwh2\") pod \"ovnkube-node-6qzgs\" (UID: \"9564eb5a-61ba-4bc5-926d-9e3ebc86096a\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:21.905060 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.905049 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slkzs\" (UniqueName: \"kubernetes.io/projected/aa5147a2-6d00-4fa1-be5a-650ddac89357-kube-api-access-slkzs\") pod \"tuned-z9zjs\" (UID: \"aa5147a2-6d00-4fa1-be5a-650ddac89357\") " pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:21.905229 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.905147 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p4mk\" (UniqueName: \"kubernetes.io/projected/7d811657-ec09-4670-a288-cff11495d583-kube-api-access-7p4mk\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:21.982947 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.982868 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mgrxr" Sep 09 17:40:21.990880 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.990857 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hb6c" Sep 09 17:40:21.999668 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:21.999645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cp64t" Sep 09 17:40:22.005399 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.005384 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:22.013069 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.013043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" Sep 09 17:40:22.019264 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.019238 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qmqql" Sep 09 17:40:22.025727 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.025709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rr4p" Sep 09 17:40:22.031471 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.031454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:22.035596 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.035571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" Sep 09 17:40:22.216814 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.216669 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9564eb5a_61ba_4bc5_926d_9e3ebc86096a.slice/crio-668f6782a79b319f0d128a1dacd70eadfdde239f13a3b6206d56b4da599ab26b WatchSource:0}: Error finding container 668f6782a79b319f0d128a1dacd70eadfdde239f13a3b6206d56b4da599ab26b: Status 404 returned error can't find the container with id 668f6782a79b319f0d128a1dacd70eadfdde239f13a3b6206d56b4da599ab26b Sep 09 17:40:22.229037 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.229013 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ef575f_4452_4af6_8ca7_abc5806b4d78.slice/crio-113484c1b99f411d879e617a6a4178239962125a019b7cb3979a78048270b10b WatchSource:0}: Error finding container 113484c1b99f411d879e617a6a4178239962125a019b7cb3979a78048270b10b: Status 404 returned error can't find the container with id 113484c1b99f411d879e617a6a4178239962125a019b7cb3979a78048270b10b Sep 09 17:40:22.236748 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.236723 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode489c1e7_7d01_48bc_bbb7_0100bd77706a.slice/crio-661183299d619bd5a33c6eccd927224213b4bda51562abd58e74447f3556d2d5 WatchSource:0}: Error finding container 661183299d619bd5a33c6eccd927224213b4bda51562abd58e74447f3556d2d5: Status 404 returned error can't find the container with id 661183299d619bd5a33c6eccd927224213b4bda51562abd58e74447f3556d2d5 Sep 09 17:40:22.237649 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.237626 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd1ae53_ad9e_4894_a132_2a315fbea789.slice/crio-504cde821afb03132b8b5ff001e40b2e9909035d47bb0f27f70ac9c793038914 WatchSource:0}: Error finding container 504cde821afb03132b8b5ff001e40b2e9909035d47bb0f27f70ac9c793038914: Status 404 returned error can't find the container with id 504cde821afb03132b8b5ff001e40b2e9909035d47bb0f27f70ac9c793038914 Sep 09 17:40:22.238418 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.238325 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf6216f_f80d_48a6_944a_f96835051e16.slice/crio-f771af4917a5e2044fbb32e1013586658c87a392a6a7cf9a120a71953d73895a WatchSource:0}: Error finding container f771af4917a5e2044fbb32e1013586658c87a392a6a7cf9a120a71953d73895a: Status 404 returned error can't find the container with id f771af4917a5e2044fbb32e1013586658c87a392a6a7cf9a120a71953d73895a Sep 09 17:40:22.239062 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.239041 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87bee1a_d630_4591_a4b2_b2513f15b65b.slice/crio-99a707df72a5726752c58a15e707f47ac2bca211f371e98c35d15e90533c3526 WatchSource:0}: Error finding container 99a707df72a5726752c58a15e707f47ac2bca211f371e98c35d15e90533c3526: Status 404 returned error can't find the container with id 99a707df72a5726752c58a15e707f47ac2bca211f371e98c35d15e90533c3526 Sep 09 17:40:22.239926 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.239871 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561c0770_1a7a_4caf_a8d5_947681590769.slice/crio-368de5007f0c238d5d30d79b6488e9045cde30f586813e77875340458695208b WatchSource:0}: Error finding container 368de5007f0c238d5d30d79b6488e9045cde30f586813e77875340458695208b: Status 404 returned error can't find the container with id 368de5007f0c238d5d30d79b6488e9045cde30f586813e77875340458695208b Sep 09 17:40:22.240905 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.240786 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c17deb_7f67_40b9_93e8_357024b178f4.slice/crio-3ac971b087b52613c6418eac5ab51df0bbcf67a61042751276432d5eccc4b942 WatchSource:0}: Error finding container 3ac971b087b52613c6418eac5ab51df0bbcf67a61042751276432d5eccc4b942: Status 404 returned error can't find the container with id 3ac971b087b52613c6418eac5ab51df0bbcf67a61042751276432d5eccc4b942 Sep 09 17:40:22.242076 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:22.242055 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5147a2_6d00_4fa1_be5a_650ddac89357.slice/crio-874dffad0d2316d91fc7b85b5f3a0709b0a72c809cdf936d86a63369e4df7d4e WatchSource:0}: Error finding container 874dffad0d2316d91fc7b85b5f3a0709b0a72c809cdf936d86a63369e4df7d4e: Status 404 returned error can't find the container with id 874dffad0d2316d91fc7b85b5f3a0709b0a72c809cdf936d86a63369e4df7d4e Sep 09 17:40:22.399263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.399224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:22.399426 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.399282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:22.399426 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.399407 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:22.399553 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.399466 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs podName:7d811657-ec09-4670-a288-cff11495d583 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:23.399447468 +0000 UTC m=+4.048390265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs") pod "network-metrics-daemon-9c82n" (UID: "7d811657-ec09-4670-a288-cff11495d583") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:22.399553 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.399407 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:22.399553 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.399511 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret podName:50d86b33-a0cf-462c-b284-e1672e2c7639 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:23.399501652 +0000 UTC m=+4.048444466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret") pod "global-pull-secret-syncer-l8gf9" (UID: "50d86b33-a0cf-462c-b284-e1672e2c7639") : object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:22.500603 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.500568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:22.500730 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.500706 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 17:40:22.500790 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.500731 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 17:40:22.500790 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.500744 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4lw7f for pod openshift-network-diagnostics/network-check-target-rmgb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:22.500892 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.500798 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f podName:e138a63d-f237-4951-9956-f1bde324298e nodeName:}" failed. No retries permitted until 2026-09-09 17:40:23.500780578 +0000 UTC m=+4.149723387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lw7f" (UniqueName: "kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f") pod "network-check-target-rmgb6" (UID: "e138a63d-f237-4951-9956-f1bde324298e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:22.725362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.725290 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 17:35:21 +0000 UTC" deadline="2028-03-05 01:52:50.57570532 +0000 UTC" Sep 09 17:40:22.725362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.725358 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13016h12m27.850351861s" Sep 09 17:40:22.817918 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.817218 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:22.817918 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.817400 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:22.817918 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.817746 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:22.817918 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:22.817842 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:22.827085 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.827051 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" event={"ID":"aa5147a2-6d00-4fa1-be5a-650ddac89357","Type":"ContainerStarted","Data":"874dffad0d2316d91fc7b85b5f3a0709b0a72c809cdf936d86a63369e4df7d4e"} Sep 09 17:40:22.829461 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.829436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" event={"ID":"561c0770-1a7a-4caf-a8d5-947681590769","Type":"ContainerStarted","Data":"368de5007f0c238d5d30d79b6488e9045cde30f586813e77875340458695208b"} Sep 09 17:40:22.832329 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.832306 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qmqql" event={"ID":"d9c17deb-7f67-40b9-93e8-357024b178f4","Type":"ContainerStarted","Data":"3ac971b087b52613c6418eac5ab51df0bbcf67a61042751276432d5eccc4b942"} Sep 09 17:40:22.839487 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.839460 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbc6q" event={"ID":"a87bee1a-d630-4591-a4b2-b2513f15b65b","Type":"ContainerStarted","Data":"99a707df72a5726752c58a15e707f47ac2bca211f371e98c35d15e90533c3526"} Sep 09 17:40:22.846206 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.846159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerStarted","Data":"504cde821afb03132b8b5ff001e40b2e9909035d47bb0f27f70ac9c793038914"} Sep 09 17:40:22.854513 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.854462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mgrxr" event={"ID":"fbf6216f-f80d-48a6-944a-f96835051e16","Type":"ContainerStarted","Data":"f771af4917a5e2044fbb32e1013586658c87a392a6a7cf9a120a71953d73895a"} Sep 09 17:40:22.856902 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.856857 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hb6c" event={"ID":"e489c1e7-7d01-48bc-bbb7-0100bd77706a","Type":"ContainerStarted","Data":"661183299d619bd5a33c6eccd927224213b4bda51562abd58e74447f3556d2d5"} Sep 09 17:40:22.859546 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.859484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rr4p" event={"ID":"54ef575f-4452-4af6-8ca7-abc5806b4d78","Type":"ContainerStarted","Data":"113484c1b99f411d879e617a6a4178239962125a019b7cb3979a78048270b10b"} Sep 09 17:40:22.863144 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.863064 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"668f6782a79b319f0d128a1dacd70eadfdde239f13a3b6206d56b4da599ab26b"} Sep 09 17:40:22.876924 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.876114 2561 generic.go:356] "Generic (PLEG): container finished" podID="355b170cb2bd0f1c678699fb0400a4e0" containerID="caf2838abe497a786e9d86cafa95f7617005c58ef58cb5548ed391f2de48348c" exitCode=0 Sep 09 17:40:22.876924 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:22.876151 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" event={"ID":"355b170cb2bd0f1c678699fb0400a4e0","Type":"ContainerDied","Data":"caf2838abe497a786e9d86cafa95f7617005c58ef58cb5548ed391f2de48348c"} Sep 09 17:40:23.406669 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:23.406586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:23.406669 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:23.406644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:23.406886 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.406804 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:23.406886 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.406865 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs podName:7d811657-ec09-4670-a288-cff11495d583 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:25.406846886 +0000 UTC m=+6.055789683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs") pod "network-metrics-daemon-9c82n" (UID: "7d811657-ec09-4670-a288-cff11495d583") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:23.407281 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.407264 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:23.407363 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.407331 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret podName:50d86b33-a0cf-462c-b284-e1672e2c7639 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:25.407309606 +0000 UTC m=+6.056252407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret") pod "global-pull-secret-syncer-l8gf9" (UID: "50d86b33-a0cf-462c-b284-e1672e2c7639") : object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:23.507764 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:23.507728 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:23.507973 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.507945 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 17:40:23.508049 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.507983 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 17:40:23.508049 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.507996 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4lw7f for pod openshift-network-diagnostics/network-check-target-rmgb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:23.508147 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.508056 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f podName:e138a63d-f237-4951-9956-f1bde324298e nodeName:}" failed. No retries permitted until 2026-09-09 17:40:25.508037127 +0000 UTC m=+6.156979926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lw7f" (UniqueName: "kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f") pod "network-check-target-rmgb6" (UID: "e138a63d-f237-4951-9956-f1bde324298e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:23.726491 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:23.726373 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 17:35:21 +0000 UTC" deadline="2028-04-05 05:00:22.70559666 +0000 UTC" Sep 09 17:40:23.726491 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:23.726412 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13763h19m58.979189219s" Sep 09 17:40:23.819867 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:23.819839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:23.820053 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:23.819991 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:23.908998 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:23.908760 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" event={"ID":"355b170cb2bd0f1c678699fb0400a4e0","Type":"ContainerStarted","Data":"ae202236a8880029264bbd2d80b1c0776bd6f0c2bbfb795db97763bdf27845d0"} Sep 09 17:40:24.817200 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:24.817171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:24.817775 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:24.817304 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:24.817775 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:24.817716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:24.817895 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:24.817815 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:25.425813 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:25.425766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:25.425992 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:25.425820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:25.426057 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.426029 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:25.426126 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.426087 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret podName:50d86b33-a0cf-462c-b284-e1672e2c7639 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:29.426071445 +0000 UTC m=+10.075014238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret") pod "global-pull-secret-syncer-l8gf9" (UID: "50d86b33-a0cf-462c-b284-e1672e2c7639") : object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:25.426514 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.425965 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:25.426514 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.426491 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs podName:7d811657-ec09-4670-a288-cff11495d583 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:29.426472907 +0000 UTC m=+10.075415704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs") pod "network-metrics-daemon-9c82n" (UID: "7d811657-ec09-4670-a288-cff11495d583") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:25.527547 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:25.526920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:25.527547 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.527096 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 17:40:25.527547 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.527116 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 17:40:25.527547 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.527137 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4lw7f for pod openshift-network-diagnostics/network-check-target-rmgb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:25.527547 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.527197 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f podName:e138a63d-f237-4951-9956-f1bde324298e nodeName:}" failed. No retries permitted until 2026-09-09 17:40:29.527180011 +0000 UTC m=+10.176122820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lw7f" (UniqueName: "kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f") pod "network-check-target-rmgb6" (UID: "e138a63d-f237-4951-9956-f1bde324298e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:25.817562 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:25.817431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:25.818000 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:25.817588 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:26.817672 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:26.817126 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:26.817672 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:26.817266 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:26.817672 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:26.817324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:26.817672 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:26.817443 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:27.818113 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:27.817571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:27.818113 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:27.817722 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:28.816995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:28.816901 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:28.816995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:28.816936 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:28.817265 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:28.817047 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:28.817265 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:28.817085 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:29.466219 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:29.466119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:29.466219 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:29.466203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:29.466720 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.466320 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:29.466720 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.466381 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret podName:50d86b33-a0cf-462c-b284-e1672e2c7639 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:37.466363384 +0000 UTC m=+18.115306184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret") pod "global-pull-secret-syncer-l8gf9" (UID: "50d86b33-a0cf-462c-b284-e1672e2c7639") : object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:29.466720 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.466444 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:29.466720 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.466476 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs podName:7d811657-ec09-4670-a288-cff11495d583 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:37.466464436 +0000 UTC m=+18.115407231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs") pod "network-metrics-daemon-9c82n" (UID: "7d811657-ec09-4670-a288-cff11495d583") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:29.567333 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:29.567254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:29.567516 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.567438 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 17:40:29.567516 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.567461 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 17:40:29.567516 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.567471 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4lw7f for pod openshift-network-diagnostics/network-check-target-rmgb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:29.567626 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.567535 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f podName:e138a63d-f237-4951-9956-f1bde324298e nodeName:}" failed. No retries permitted until 2026-09-09 17:40:37.567515787 +0000 UTC m=+18.216458586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lw7f" (UniqueName: "kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f") pod "network-check-target-rmgb6" (UID: "e138a63d-f237-4951-9956-f1bde324298e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:29.819139 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:29.819058 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:29.819308 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:29.819175 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:30.816605 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:30.816570 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:30.817091 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:30.816620 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:30.817091 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:30.816708 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:30.817091 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:30.816866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:31.817021 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:31.816928 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:31.817512 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:31.817218 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:32.817442 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:32.817420 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:32.817823 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:32.817420 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:32.817823 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:32.817550 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:32.817823 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:32.817578 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:33.817205 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:33.817170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:33.817401 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:33.817336 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:34.817020 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:34.816990 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:34.817422 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:34.816992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:34.817422 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:34.817096 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:34.817422 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:34.817179 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:35.816907 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:35.816868 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:35.817093 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:35.817020 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:36.817403 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:36.817367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:36.817947 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:36.817383 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:36.817947 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:36.817488 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:36.817947 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:36.817564 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:37.528304 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:37.528265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:37.528482 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:37.528324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:37.528482 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.528420 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:37.528482 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.528429 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:37.528626 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.528491 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret podName:50d86b33-a0cf-462c-b284-e1672e2c7639 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:53.5284721 +0000 UTC m=+34.177414923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret") pod "global-pull-secret-syncer-l8gf9" (UID: "50d86b33-a0cf-462c-b284-e1672e2c7639") : object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:37.528626 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.528506 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs podName:7d811657-ec09-4670-a288-cff11495d583 nodeName:}" failed. No retries permitted until 2026-09-09 17:40:53.528498744 +0000 UTC m=+34.177441541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs") pod "network-metrics-daemon-9c82n" (UID: "7d811657-ec09-4670-a288-cff11495d583") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:37.628810 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:37.628772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:37.628998 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.628977 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 17:40:37.629070 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.629003 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 17:40:37.629070 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.629013 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4lw7f for pod openshift-network-diagnostics/network-check-target-rmgb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:37.629155 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.629070 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f podName:e138a63d-f237-4951-9956-f1bde324298e nodeName:}" failed. No retries permitted until 2026-09-09 17:40:53.629052867 +0000 UTC m=+34.277995664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lw7f" (UniqueName: "kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f") pod "network-check-target-rmgb6" (UID: "e138a63d-f237-4951-9956-f1bde324298e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:37.817561 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:37.817483 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:37.817992 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:37.817678 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:38.817113 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:38.817080 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:38.817113 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:38.817105 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:38.817343 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:38.817208 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:38.817343 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:38.817308 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:39.817798 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:39.817765 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:39.818182 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:39.817851 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:40.818462 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.818245 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:40.818776 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.818323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:40.818865 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:40.818766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:40.818865 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:40.818836 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:40.948067 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.947884 2561 generic.go:356] "Generic (PLEG): container finished" podID="afd1ae53-ad9e-4894-a132-2a315fbea789" containerID="3364f34188fe6b63d48f59c037822b3a6cedf574fe5c3c420578ed2d893982c0" exitCode=0 Sep 09 17:40:40.948175 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.947982 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerDied","Data":"3364f34188fe6b63d48f59c037822b3a6cedf574fe5c3c420578ed2d893982c0"} Sep 09 17:40:40.950772 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.950722 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mgrxr" event={"ID":"fbf6216f-f80d-48a6-944a-f96835051e16","Type":"ContainerStarted","Data":"2b88b1e5dbb191d96e3dba470e987fbde92bcb30c0ced2b18a6965b44f0fe4fd"} Sep 09 17:40:40.954825 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.954799 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hb6c" event={"ID":"e489c1e7-7d01-48bc-bbb7-0100bd77706a","Type":"ContainerStarted","Data":"962755aa249339d9b5d4d3714cdea984cd080766486dd5b204463ea0421ade50"} Sep 09 17:40:40.958121 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.958100 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:40:40.958664 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.958639 2561 generic.go:356] "Generic (PLEG): container finished" podID="9564eb5a-61ba-4bc5-926d-9e3ebc86096a" containerID="1fce39e6a87000d5425307d63d0e91f600e9f67474215b4012f2e7774c66364a" exitCode=1 Sep 09 17:40:40.958756 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.958674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"91c2dc6642a31219ce392422b60153ad94d821896bdf5e8b3be0c602537edcc6"} Sep 09 17:40:40.958756 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.958742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"ff3f99335a74fc6f60289beeb1236662def3a93502e33fdaf39e55c62a6f34fa"} Sep 09 17:40:40.958854 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.958794 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerDied","Data":"1fce39e6a87000d5425307d63d0e91f600e9f67474215b4012f2e7774c66364a"} Sep 09 17:40:40.958854 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.958847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"3f579904cc0a397fec62317c12043ad06885132da5754f4bfe7d3381050509c8"} Sep 09 17:40:40.960709 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.960686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" event={"ID":"1b6497d2a1dab0e32472faf9c39d7ed3","Type":"ContainerStarted","Data":"4e8ce3819ce53783e4bd57d78f70493d6f2008341d4ecdbcbc7f3381e8fe6c2e"} Sep 09 17:40:40.962442 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.962422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" event={"ID":"aa5147a2-6d00-4fa1-be5a-650ddac89357","Type":"ContainerStarted","Data":"17c481b264fb8e0b97a662a102b1e3e8b8f8b59e3571e107b055be26ba5eda1e"} Sep 09 17:40:40.964006 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.963984 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" event={"ID":"561c0770-1a7a-4caf-a8d5-947681590769","Type":"ContainerStarted","Data":"f80616ae07b79783541d966de4681048e1ae55ee87580c2290c6fdf6579c6084"} Sep 09 17:40:40.965471 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.965450 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qmqql" event={"ID":"d9c17deb-7f67-40b9-93e8-357024b178f4","Type":"ContainerStarted","Data":"9705ed5ed4299b8b4724917646a01379ef748914b03ceb16a0f3ef8d9c71854a"} Sep 09 17:40:40.967134 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.967086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbc6q" event={"ID":"a87bee1a-d630-4591-a4b2-b2513f15b65b","Type":"ContainerStarted","Data":"33e3f201e82bcaf48b9bb72224f6a2606402aefb0b6a92b0986d8ef195a09750"} Sep 09 17:40:40.971025 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.970978 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-216.ec2.internal" podStartSLOduration=20.970947819 podStartE2EDuration="20.970947819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:23.925274834 +0000 UTC m=+4.574217651" watchObservedRunningTime="2026-09-09 17:40:40.970947819 +0000 UTC m=+21.619890638" Sep 09 17:40:40.999627 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:40.999569 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mgrxr" podStartSLOduration=3.935708555 podStartE2EDuration="21.999550757s" totalImagesPullingTime="18.063842202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:40.984440211 +0000 UTC m=+21.633383029" watchObservedRunningTime="2026-09-09 17:40:40.999550757 +0000 UTC m=+21.648493578" Sep 09 17:40:41.000238 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.000204 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7hb6c" podStartSLOduration=8.076251977 podStartE2EDuration="22.000193983s" totalImagesPullingTime="13.923942006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:40.998968981 +0000 UTC m=+21.647911790" watchObservedRunningTime="2026-09-09 17:40:41.000193983 +0000 UTC m=+21.649136801" Sep 09 17:40:41.014152 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.014103 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qmqql" podStartSLOduration=2.910949225 podStartE2EDuration="21.014088703s" totalImagesPullingTime="18.103139478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:41.013560319 +0000 UTC m=+21.662503136" watchObservedRunningTime="2026-09-09 17:40:41.014088703 +0000 UTC m=+21.663031521" Sep 09 17:40:41.026063 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.026028 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-216.ec2.internal" podStartSLOduration=21.026015633 podStartE2EDuration="21.026015633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:41.025864629 +0000 UTC m=+21.674807448" watchObservedRunningTime="2026-09-09 17:40:41.026015633 +0000 UTC m=+21.674958511" Sep 09 17:40:41.039569 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.039496 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qbc6q" podStartSLOduration=3.976558315 podStartE2EDuration="22.039485731s" totalImagesPullingTime="18.062927416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:41.039471064 +0000 UTC m=+21.688413880" watchObservedRunningTime="2026-09-09 17:40:41.039485731 +0000 UTC m=+21.688428546" Sep 09 17:40:41.055718 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.055680 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z9zjs" podStartSLOduration=2.996178179 podStartE2EDuration="21.055667947s" totalImagesPullingTime="18.059489768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:41.055538726 +0000 UTC m=+21.704481542" watchObservedRunningTime="2026-09-09 17:40:41.055667947 +0000 UTC m=+21.704610763" Sep 09 17:40:41.685829 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.685807 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 17:40:41.743107 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.743024 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T17:40:41.685823512Z","UUID":"3adbccbf-d704-41d6-bea1-956b06ecf19f","Handler":null,"Name":"","Endpoint":""} Sep 09 17:40:41.744518 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.744503 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 17:40:41.744620 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.744532 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 17:40:41.817459 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.817431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:41.817611 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:41.817541 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:41.971601 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.971522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" event={"ID":"561c0770-1a7a-4caf-a8d5-947681590769","Type":"ContainerStarted","Data":"a98a1b1a26a820f6d3854c3813a202dbaa677a453a1289856b6979ffcbed5b25"} Sep 09 17:40:41.973338 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.973314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rr4p" event={"ID":"54ef575f-4452-4af6-8ca7-abc5806b4d78","Type":"ContainerStarted","Data":"e1a9848f03e0be95750eb08b282039d1d7c811ac6afaab895c69dd27112f86a5"} Sep 09 17:40:41.976071 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.976052 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:40:41.976487 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.976466 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"49b99f27ab77b39f4ccb5f6e18e24f9c3be3cbbc5903dba420ddd7c472ba59e3"} Sep 09 17:40:41.976543 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.976532 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"3b1ea17ac86660b6c7d8bed4bced1e036537074aa68a7d6e3fefc8616a457966"} Sep 09 17:40:41.986516 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:41.986479 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7rr4p" podStartSLOduration=3.938060369 podStartE2EDuration="21.986466629s" totalImagesPullingTime="18.04840626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:41.986142643 +0000 UTC m=+22.635085460" watchObservedRunningTime="2026-09-09 17:40:41.986466629 +0000 UTC m=+22.635409484" Sep 09 17:40:42.817585 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:42.817554 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:42.817773 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:42.817558 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:42.817773 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:42.817675 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:42.817773 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:42.817747 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:42.832684 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:42.832651 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:42.833219 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:42.833199 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:42.978490 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:42.978461 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:42.978918 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:42.978885 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qbc6q" Sep 09 17:40:43.816861 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:43.816785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:43.817016 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:43.816906 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:43.983035 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:43.983000 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" event={"ID":"561c0770-1a7a-4caf-a8d5-947681590769","Type":"ContainerStarted","Data":"cadaed8de99588f149cf624ecfa4f326a5d520e856ed473a8d4d11cac8e3f112"} Sep 09 17:40:43.988192 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:43.988166 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:40:43.988892 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:43.988865 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"c1ea391cad60288c1c93dfc2fb99b3af19555a3e7185e7e244d96c1abaf102c9"} Sep 09 17:40:44.000469 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:44.000429 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bc69h" podStartSLOduration=8.249152895 podStartE2EDuration="25.000414289s" totalImagesPullingTime="16.751261394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:43.998825505 +0000 UTC m=+24.647768321" watchObservedRunningTime="2026-09-09 17:40:44.000414289 +0000 UTC m=+24.649357115" Sep 09 17:40:44.816918 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:44.816882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:44.817097 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:44.816898 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:44.817097 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:44.817032 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:44.817097 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:44.817085 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:45.817441 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:45.817408 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:45.817873 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:45.817521 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:45.995222 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:45.995008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerStarted","Data":"dde2dab744534695c4c04a0a2d94d80ce4da890c58e9a7ed8fc48d3e6e326fbd"} Sep 09 17:40:45.998716 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:45.998689 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:40:45.999225 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:45.999199 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"45e2696e83dcea9c3cdfd9687d61bb65b4832c624a0e39dfe17f55d0530a535e"} Sep 09 17:40:45.999498 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:45.999476 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:45.999560 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:45.999547 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:45.999696 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:45.999680 2561 scope.go:117] "RemoveContainer" containerID="1fce39e6a87000d5425307d63d0e91f600e9f67474215b4012f2e7774c66364a" Sep 09 17:40:46.014543 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:46.014521 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:46.816561 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:46.816530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:46.816689 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:46.816530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:46.816689 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:46.816664 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:46.816793 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:46.816775 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:47.004654 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.004587 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:40:47.005168 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.004980 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" event={"ID":"9564eb5a-61ba-4bc5-926d-9e3ebc86096a","Type":"ContainerStarted","Data":"275d7ed7e0f5f4138d513a71c66afdc451ef4e5fd8eb5c1ea508dbe4839c328b"} Sep 09 17:40:47.005168 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.005066 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:47.010261 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.010225 2561 generic.go:356] "Generic (PLEG): container finished" podID="afd1ae53-ad9e-4894-a132-2a315fbea789" containerID="dde2dab744534695c4c04a0a2d94d80ce4da890c58e9a7ed8fc48d3e6e326fbd" exitCode=0 Sep 09 17:40:47.010390 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.010279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerDied","Data":"dde2dab744534695c4c04a0a2d94d80ce4da890c58e9a7ed8fc48d3e6e326fbd"} Sep 09 17:40:47.021195 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.021175 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:40:47.034995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.034939 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" podStartSLOduration=8.694461157 podStartE2EDuration="27.034926392s" totalImagesPullingTime="18.340465235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:47.033453818 +0000 UTC m=+27.682396633" watchObservedRunningTime="2026-09-09 17:40:47.034926392 +0000 UTC m=+27.683869208" Sep 09 17:40:47.817397 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:47.817358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:47.817557 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:47.817516 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:48.817118 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:48.817073 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:48.817573 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:48.817073 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:48.817573 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:48.817202 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:48.817573 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:48.817255 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:49.016681 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:49.016644 2561 generic.go:356] "Generic (PLEG): container finished" podID="afd1ae53-ad9e-4894-a132-2a315fbea789" containerID="9feda9225e8dd6872e79b548e70dda9ac70376d52a9ff5214525132d85bd95d5" exitCode=0 Sep 09 17:40:49.016816 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:49.016713 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerDied","Data":"9feda9225e8dd6872e79b548e70dda9ac70376d52a9ff5214525132d85bd95d5"} Sep 09 17:40:49.817943 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:49.817919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:49.818408 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:49.818044 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:50.021647 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:50.021611 2561 generic.go:356] "Generic (PLEG): container finished" podID="afd1ae53-ad9e-4894-a132-2a315fbea789" containerID="e6990888306f5264a1b88534b4e5a670584dbe8e342519863dbeb29d38a77852" exitCode=0 Sep 09 17:40:50.021785 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:50.021668 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerDied","Data":"e6990888306f5264a1b88534b4e5a670584dbe8e342519863dbeb29d38a77852"} Sep 09 17:40:50.817546 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:50.817511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:50.817758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:50.817513 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:50.817758 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:50.817652 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:50.817758 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:50.817725 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:51.817570 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:51.817537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:51.818089 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:51.817702 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:52.816704 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:52.816673 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:52.816944 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:52.816673 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:52.816944 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:52.816771 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:52.816944 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:52.816816 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:53.550097 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:53.550057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:53.550525 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:53.550109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:53.550525 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.550223 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:53.550525 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.550226 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:53.550525 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.550291 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs podName:7d811657-ec09-4670-a288-cff11495d583 nodeName:}" failed. No retries permitted until 2026-09-09 17:41:25.550270848 +0000 UTC m=+66.199213674 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs") pod "network-metrics-daemon-9c82n" (UID: "7d811657-ec09-4670-a288-cff11495d583") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 17:40:53.550525 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.550310 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret podName:50d86b33-a0cf-462c-b284-e1672e2c7639 nodeName:}" failed. No retries permitted until 2026-09-09 17:41:25.550301239 +0000 UTC m=+66.199244034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret") pod "global-pull-secret-syncer-l8gf9" (UID: "50d86b33-a0cf-462c-b284-e1672e2c7639") : object "kube-system"/"original-pull-secret" not registered Sep 09 17:40:53.650607 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:53.650571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:53.650775 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.650713 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 17:40:53.650775 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.650736 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 17:40:53.650775 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.650748 2561 projected.go:196] Error preparing data for projected volume kube-api-access-4lw7f for pod openshift-network-diagnostics/network-check-target-rmgb6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:53.650922 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.650808 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f podName:e138a63d-f237-4951-9956-f1bde324298e nodeName:}" failed. No retries permitted until 2026-09-09 17:41:25.650790187 +0000 UTC m=+66.299732981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lw7f" (UniqueName: "kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f") pod "network-check-target-rmgb6" (UID: "e138a63d-f237-4951-9956-f1bde324298e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 17:40:53.817178 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:53.817100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:53.817338 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:53.817238 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:54.817561 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:54.817256 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:54.817937 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:54.817624 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:54.817937 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:54.817453 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:54.817937 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:54.817929 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:54.819128 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:54.819064 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rmgb6"] Sep 09 17:40:54.822368 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:54.822286 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9c82n"] Sep 09 17:40:54.822574 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:54.822555 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:54.822807 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:54.822744 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:54.822994 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:54.822968 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l8gf9"] Sep 09 17:40:55.036186 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:55.036158 2561 generic.go:356] "Generic (PLEG): container finished" podID="afd1ae53-ad9e-4894-a132-2a315fbea789" containerID="869d2b061178d2bbe262d2372adb6abcbaf467d86e4425aa3a4eb5565497fedc" exitCode=0 Sep 09 17:40:55.036367 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:55.036224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerDied","Data":"869d2b061178d2bbe262d2372adb6abcbaf467d86e4425aa3a4eb5565497fedc"} Sep 09 17:40:55.036367 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:55.036242 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:55.036367 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:55.036317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:55.036367 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:55.036327 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:55.036515 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:55.036397 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:56.041766 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:56.041686 2561 generic.go:356] "Generic (PLEG): container finished" podID="afd1ae53-ad9e-4894-a132-2a315fbea789" containerID="c9a3abc94d07177a8d6904eb4e5d123c3e29886e2f215628ecfbd5936150ef2a" exitCode=0 Sep 09 17:40:56.041766 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:56.041739 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerDied","Data":"c9a3abc94d07177a8d6904eb4e5d123c3e29886e2f215628ecfbd5936150ef2a"} Sep 09 17:40:56.817491 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:56.817310 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:56.817651 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:56.817315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:56.817651 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:56.817560 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:56.817651 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:56.817315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:56.817764 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:56.817646 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:56.817764 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:56.817717 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:57.047809 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:57.047776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cp64t" event={"ID":"afd1ae53-ad9e-4894-a132-2a315fbea789","Type":"ContainerStarted","Data":"0101a0df2109c2851f0e76947965b8f91bbf083b3c5c51b4f30a00bcce60afb9"} Sep 09 17:40:57.067460 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:57.067408 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cp64t" podStartSLOduration=8.560319011 podStartE2EDuration="38.06739187s" totalImagesPullingTime="29.507072859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:40:57.066615833 +0000 UTC m=+37.715558650" watchObservedRunningTime="2026-09-09 17:40:57.06739187 +0000 UTC m=+37.716334686" Sep 09 17:40:58.816737 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:58.816705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:40:58.817193 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:58.816805 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:40:58.817193 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:58.816808 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8gf9" podUID="50d86b33-a0cf-462c-b284-e1672e2c7639" Sep 09 17:40:58.817193 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:58.816839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:40:58.817193 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:58.816936 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rmgb6" podUID="e138a63d-f237-4951-9956-f1bde324298e" Sep 09 17:40:58.817193 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:40:58.817014 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9c82n" podUID="7d811657-ec09-4670-a288-cff11495d583" Sep 09 17:40:59.114418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.114388 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-216.ec2.internal" event="NodeReady" Sep 09 17:40:59.114608 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.114495 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 17:40:59.163991 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.163946 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t7wfs"] Sep 09 17:40:59.184786 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.184755 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6b52c"] Sep 09 17:40:59.184934 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.184912 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.187315 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.187290 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 17:40:59.187526 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.187505 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 17:40:59.187724 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.187413 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rtp6s\"" Sep 09 17:40:59.187872 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.187350 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 17:40:59.208773 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.208750 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7wfs"] Sep 09 17:40:59.208773 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.208777 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6b52c"] Sep 09 17:40:59.208894 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.208807 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7vd7b"] Sep 09 17:40:59.208894 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.208874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.210814 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.210796 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 17:40:59.210928 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.210860 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 17:40:59.210928 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.210877 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 17:40:59.210928 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.210908 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-klfqc\"" Sep 09 17:40:59.211237 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.211223 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 17:40:59.228966 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.228932 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vd7b"] Sep 09 17:40:59.229054 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.229039 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.230987 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.230973 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 17:40:59.230987 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.230981 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 17:40:59.231067 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.230981 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vlvqv\"" Sep 09 17:40:59.292264 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.292226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpdgx\" (UniqueName: \"kubernetes.io/projected/3df191bb-652f-462d-a9db-0b0ac9d4558f-kube-api-access-dpdgx\") pod \"ingress-canary-t7wfs\" (UID: \"3df191bb-652f-462d-a9db-0b0ac9d4558f\") " pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.292414 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.292277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3df191bb-652f-462d-a9db-0b0ac9d4558f-cert\") pod \"ingress-canary-t7wfs\" (UID: \"3df191bb-652f-462d-a9db-0b0ac9d4558f\") " pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.393627 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7fl2\" (UniqueName: \"kubernetes.io/projected/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-kube-api-access-c7fl2\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.393627 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d5d149a-68c2-408e-a928-796af55ff36f-tmp-dir\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.393777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpdgx\" (UniqueName: \"kubernetes.io/projected/3df191bb-652f-462d-a9db-0b0ac9d4558f-kube-api-access-dpdgx\") pod \"ingress-canary-t7wfs\" (UID: \"3df191bb-652f-462d-a9db-0b0ac9d4558f\") " pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.393777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-crio-socket\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.393777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.393777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d5d149a-68c2-408e-a928-796af55ff36f-config-volume\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.393777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5d149a-68c2-408e-a928-796af55ff36f-metrics-tls\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.393777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.393997 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-data-volume\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.393997 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5mrp\" (UniqueName: \"kubernetes.io/projected/8d5d149a-68c2-408e-a928-796af55ff36f-kube-api-access-p5mrp\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.393997 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.393890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3df191bb-652f-462d-a9db-0b0ac9d4558f-cert\") pod \"ingress-canary-t7wfs\" (UID: \"3df191bb-652f-462d-a9db-0b0ac9d4558f\") " pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.397906 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.397889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3df191bb-652f-462d-a9db-0b0ac9d4558f-cert\") pod \"ingress-canary-t7wfs\" (UID: \"3df191bb-652f-462d-a9db-0b0ac9d4558f\") " pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.400854 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.400830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpdgx\" (UniqueName: \"kubernetes.io/projected/3df191bb-652f-462d-a9db-0b0ac9d4558f-kube-api-access-dpdgx\") pod \"ingress-canary-t7wfs\" (UID: \"3df191bb-652f-462d-a9db-0b0ac9d4558f\") " pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.494245 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494208 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7wfs" Sep 09 17:40:59.494411 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-crio-socket\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.494411 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.494411 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d5d149a-68c2-408e-a928-796af55ff36f-config-volume\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.494411 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5d149a-68c2-408e-a928-796af55ff36f-metrics-tls\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.494411 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.494606 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-data-volume\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.494606 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5mrp\" (UniqueName: \"kubernetes.io/projected/8d5d149a-68c2-408e-a928-796af55ff36f-kube-api-access-p5mrp\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.494715 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494602 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-crio-socket\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.494940 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494908 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-data-volume\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.495062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.494984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7fl2\" (UniqueName: \"kubernetes.io/projected/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-kube-api-access-c7fl2\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.495062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.495021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d5d149a-68c2-408e-a928-796af55ff36f-tmp-dir\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.495062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.495037 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.495062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.495047 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d5d149a-68c2-408e-a928-796af55ff36f-config-volume\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.495248 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.495234 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d5d149a-68c2-408e-a928-796af55ff36f-tmp-dir\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.497228 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.497208 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5d149a-68c2-408e-a928-796af55ff36f-metrics-tls\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.497293 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.497213 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.502327 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.502306 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5mrp\" (UniqueName: \"kubernetes.io/projected/8d5d149a-68c2-408e-a928-796af55ff36f-kube-api-access-p5mrp\") pod \"dns-default-7vd7b\" (UID: \"8d5d149a-68c2-408e-a928-796af55ff36f\") " pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.510377 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.510359 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7fl2\" (UniqueName: \"kubernetes.io/projected/3f0e91b7-fdb0-49b8-9dec-dee0b19a775e-kube-api-access-c7fl2\") pod \"insights-runtime-extractor-6b52c\" (UID: \"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e\") " pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.517374 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.517344 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6b52c" Sep 09 17:40:59.536778 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.536756 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vd7b" Sep 09 17:40:59.811347 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.811317 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7wfs"] Sep 09 17:40:59.816402 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:59.816372 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df191bb_652f_462d_a9db_0b0ac9d4558f.slice/crio-0d6b9871bae074ffdd16cec355950c41ca20448eacb965c905f153057946ccb8 WatchSource:0}: Error finding container 0d6b9871bae074ffdd16cec355950c41ca20448eacb965c905f153057946ccb8: Status 404 returned error can't find the container with id 0d6b9871bae074ffdd16cec355950c41ca20448eacb965c905f153057946ccb8 Sep 09 17:40:59.834797 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.834774 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6b52c"] Sep 09 17:40:59.837907 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:59.837885 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0e91b7_fdb0_49b8_9dec_dee0b19a775e.slice/crio-eac9a782888f84c8a77e6f4f9b7ea056b825f1defcf9328b6b895f842e990f59 WatchSource:0}: Error finding container eac9a782888f84c8a77e6f4f9b7ea056b825f1defcf9328b6b895f842e990f59: Status 404 returned error can't find the container with id eac9a782888f84c8a77e6f4f9b7ea056b825f1defcf9328b6b895f842e990f59 Sep 09 17:40:59.863732 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:40:59.863710 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vd7b"] Sep 09 17:40:59.866626 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:40:59.866605 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5d149a_68c2_408e_a928_796af55ff36f.slice/crio-09b8eec727f9c5b4461796187733a347a76de9708e8ae2b6ecee4c3cb6b12f8f WatchSource:0}: Error finding container 09b8eec727f9c5b4461796187733a347a76de9708e8ae2b6ecee4c3cb6b12f8f: Status 404 returned error can't find the container with id 09b8eec727f9c5b4461796187733a347a76de9708e8ae2b6ecee4c3cb6b12f8f Sep 09 17:41:00.056606 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.056568 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vd7b" event={"ID":"8d5d149a-68c2-408e-a928-796af55ff36f","Type":"ContainerStarted","Data":"09b8eec727f9c5b4461796187733a347a76de9708e8ae2b6ecee4c3cb6b12f8f"} Sep 09 17:41:00.058017 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.057991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b52c" event={"ID":"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e","Type":"ContainerStarted","Data":"5605302a59321283d056cb1a219c12f665997f1cc17c07e0dd8c3d2ae14c44d9"} Sep 09 17:41:00.058127 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.058040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b52c" event={"ID":"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e","Type":"ContainerStarted","Data":"eac9a782888f84c8a77e6f4f9b7ea056b825f1defcf9328b6b895f842e990f59"} Sep 09 17:41:00.059029 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.059007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7wfs" event={"ID":"3df191bb-652f-462d-a9db-0b0ac9d4558f","Type":"ContainerStarted","Data":"0d6b9871bae074ffdd16cec355950c41ca20448eacb965c905f153057946ccb8"} Sep 09 17:41:00.361328 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.361291 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-c57rn"] Sep 09 17:41:00.380771 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.380746 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-c57rn"] Sep 09 17:41:00.380894 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.380838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.383899 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.383877 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 17:41:00.383899 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.383887 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 09 17:41:00.384173 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.383909 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 09 17:41:00.384173 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.383894 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 17:41:00.384173 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.383877 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-spv56\"" Sep 09 17:41:00.384173 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.383878 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 17:41:00.500776 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.500742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d469c0c-ac11-4e46-b97d-2536493232a5-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.500933 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.500808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.500933 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.500852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzd8m\" (UniqueName: \"kubernetes.io/projected/8d469c0c-ac11-4e46-b97d-2536493232a5-kube-api-access-vzd8m\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.500933 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.500901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.602120 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.602087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.602120 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.602121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzd8m\" (UniqueName: \"kubernetes.io/projected/8d469c0c-ac11-4e46-b97d-2536493232a5-kube-api-access-vzd8m\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.602322 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.602152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.602322 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.602186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d469c0c-ac11-4e46-b97d-2536493232a5-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.602322 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:00.602274 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 09 17:41:00.602457 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:00.602353 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-tls podName:8d469c0c-ac11-4e46-b97d-2536493232a5 nodeName:}" failed. No retries permitted until 2026-09-09 17:41:01.102330533 +0000 UTC m=+41.751273357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-c57rn" (UID: "8d469c0c-ac11-4e46-b97d-2536493232a5") : secret "prometheus-operator-tls" not found Sep 09 17:41:00.602818 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.602801 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d469c0c-ac11-4e46-b97d-2536493232a5-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.604440 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.604423 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.610138 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.610109 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzd8m\" (UniqueName: \"kubernetes.io/projected/8d469c0c-ac11-4e46-b97d-2536493232a5-kube-api-access-vzd8m\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:00.816779 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.816742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:41:00.816779 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.816768 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:41:00.817043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.816742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:41:00.819757 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.819736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xckm4\"" Sep 09 17:41:00.819889 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.819860 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 17:41:00.819985 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.819889 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 17:41:00.819985 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.819971 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g27kw\"" Sep 09 17:41:00.820097 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.820052 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 17:41:00.820188 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:00.820168 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 17:41:01.106647 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.106565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:01.109515 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.109482 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d469c0c-ac11-4e46-b97d-2536493232a5-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c57rn\" (UID: \"8d469c0c-ac11-4e46-b97d-2536493232a5\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:01.138199 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.138096 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57cb9978f7-fxcbg"] Sep 09 17:41:01.152115 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.152082 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cb9978f7-fxcbg"] Sep 09 17:41:01.152257 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.152205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.154716 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.154692 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 17:41:01.154886 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.154782 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 17:41:01.154983 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.154894 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 17:41:01.155044 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.154996 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 17:41:01.155044 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.154698 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 17:41:01.155747 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.155364 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 17:41:01.155747 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.155384 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zr8xv\"" Sep 09 17:41:01.155747 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.155609 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 17:41:01.289785 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.289745 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" Sep 09 17:41:01.308644 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.308615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-service-ca\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.308644 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.308654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-oauth-serving-cert\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.308845 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.308690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7csz\" (UniqueName: \"kubernetes.io/projected/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-kube-api-access-n7csz\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.308845 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.308826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-serving-cert\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.308972 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.308883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-config\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.309026 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.308998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-oauth-config\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.410269 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.410188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-serving-cert\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.410269 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.410261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-config\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.410502 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.410322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-oauth-config\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.410502 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.410366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-service-ca\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.410502 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.410388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-oauth-serving-cert\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.410502 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.410421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7csz\" (UniqueName: \"kubernetes.io/projected/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-kube-api-access-n7csz\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.411141 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.411116 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-config\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.411272 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.411180 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-service-ca\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.411339 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.411284 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-oauth-serving-cert\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.413173 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.413152 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-oauth-config\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.414562 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.414520 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-serving-cert\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.418590 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.418565 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7csz\" (UniqueName: \"kubernetes.io/projected/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-kube-api-access-n7csz\") pod \"console-57cb9978f7-fxcbg\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.465487 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.465306 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:01.744059 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.744026 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-c57rn"] Sep 09 17:41:01.787051 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:01.787015 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cb9978f7-fxcbg"] Sep 09 17:41:02.067537 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:02.067434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b52c" event={"ID":"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e","Type":"ContainerStarted","Data":"6ec4c5f6d252cbe3e961f19fbf5f419813b2fd62f684004a14e3a99ebc340231"} Sep 09 17:41:02.944267 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:02.944230 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d469c0c_ac11_4e46_b97d_2536493232a5.slice/crio-7b6db0f09981abcb7c0a9367323597e08c01b0d3c16428c36959e4bd41290bf1 WatchSource:0}: Error finding container 7b6db0f09981abcb7c0a9367323597e08c01b0d3c16428c36959e4bd41290bf1: Status 404 returned error can't find the container with id 7b6db0f09981abcb7c0a9367323597e08c01b0d3c16428c36959e4bd41290bf1 Sep 09 17:41:02.944759 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:02.944740 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc332827c_5b60_4a45_9a7e_ce8fc0dcc34d.slice/crio-57841e89b7efc3666d05612d87eb7570caaa03eacb7573d1e4512b2f4f8b9c22 WatchSource:0}: Error finding container 57841e89b7efc3666d05612d87eb7570caaa03eacb7573d1e4512b2f4f8b9c22: Status 404 returned error can't find the container with id 57841e89b7efc3666d05612d87eb7570caaa03eacb7573d1e4512b2f4f8b9c22 Sep 09 17:41:02.953148 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:02.953125 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659b9b985-s2d5d"] Sep 09 17:41:02.970872 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:02.970848 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:02.974447 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:02.974423 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659b9b985-s2d5d"] Sep 09 17:41:02.977896 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:02.977875 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 17:41:03.073570 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.073534 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cb9978f7-fxcbg" event={"ID":"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d","Type":"ContainerStarted","Data":"57841e89b7efc3666d05612d87eb7570caaa03eacb7573d1e4512b2f4f8b9c22"} Sep 09 17:41:03.074782 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.074759 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" event={"ID":"8d469c0c-ac11-4e46-b97d-2536493232a5","Type":"ContainerStarted","Data":"7b6db0f09981abcb7c0a9367323597e08c01b0d3c16428c36959e4bd41290bf1"} Sep 09 17:41:03.122191 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.122154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-service-ca\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.122412 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.122197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-oauth-serving-cert\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.122412 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.122229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zs25\" (UniqueName: \"kubernetes.io/projected/9602ccad-2697-466c-9df4-d198de9871e7-kube-api-access-7zs25\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.122412 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.122246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-serving-cert\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.122412 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.122259 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-console-config\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.122412 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.122275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-trusted-ca-bundle\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.122609 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.122442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-oauth-config\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.223419 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.223342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-oauth-serving-cert\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.223419 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.223402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zs25\" (UniqueName: \"kubernetes.io/projected/9602ccad-2697-466c-9df4-d198de9871e7-kube-api-access-7zs25\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.223601 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.223432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-serving-cert\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.223601 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.223464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-console-config\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.223601 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.223491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-trusted-ca-bundle\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.223601 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.223572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-oauth-config\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.223749 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.223612 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-service-ca\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.224223 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.224187 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-oauth-serving-cert\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.224415 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.224360 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-service-ca\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.224528 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.224505 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-console-config\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.224608 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.224589 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-trusted-ca-bundle\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.226215 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.226194 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-serving-cert\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.226371 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.226346 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-oauth-config\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.231493 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.231471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zs25\" (UniqueName: \"kubernetes.io/projected/9602ccad-2697-466c-9df4-d198de9871e7-kube-api-access-7zs25\") pod \"console-659b9b985-s2d5d\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.280464 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.280430 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:03.648498 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:03.648466 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659b9b985-s2d5d"] Sep 09 17:41:03.653074 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:03.653046 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9602ccad_2697_466c_9df4_d198de9871e7.slice/crio-037b1c8916feea00036f3dd6e6e60f81726f9bc25a34f3d00be45a459921642f WatchSource:0}: Error finding container 037b1c8916feea00036f3dd6e6e60f81726f9bc25a34f3d00be45a459921642f: Status 404 returned error can't find the container with id 037b1c8916feea00036f3dd6e6e60f81726f9bc25a34f3d00be45a459921642f Sep 09 17:41:04.082144 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:04.082104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659b9b985-s2d5d" event={"ID":"9602ccad-2697-466c-9df4-d198de9871e7","Type":"ContainerStarted","Data":"037b1c8916feea00036f3dd6e6e60f81726f9bc25a34f3d00be45a459921642f"} Sep 09 17:41:04.083736 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:04.083704 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vd7b" event={"ID":"8d5d149a-68c2-408e-a928-796af55ff36f","Type":"ContainerStarted","Data":"9881770d0fb94a041f9736a5f41e894ca4e6c28e867132a264c48d350ac90eb0"} Sep 09 17:41:04.083861 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:04.083746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vd7b" event={"ID":"8d5d149a-68c2-408e-a928-796af55ff36f","Type":"ContainerStarted","Data":"831f3ff38be0eafb76a5b0f7d20c0b659fb9239cd70929528973d8e9b2e997e2"} Sep 09 17:41:04.083861 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:04.083823 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7vd7b" Sep 09 17:41:04.085128 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:04.085105 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7wfs" event={"ID":"3df191bb-652f-462d-a9db-0b0ac9d4558f","Type":"ContainerStarted","Data":"5d969a083819f3f23fcf79c72275404e32aeb23baf267cb157ad97d24d3d3eff"} Sep 09 17:41:04.099672 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:04.099633 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7vd7b" podStartSLOduration=1.593983363 podStartE2EDuration="5.099616442s" totalImagesPullingTime="3.505633079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:04.098666746 +0000 UTC m=+44.747609563" watchObservedRunningTime="2026-09-09 17:41:04.099616442 +0000 UTC m=+44.748559258" Sep 09 17:41:04.115966 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:04.115918 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t7wfs" podStartSLOduration=1.555414684 podStartE2EDuration="5.115904612s" totalImagesPullingTime="3.560489928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:04.115725652 +0000 UTC m=+44.764668466" watchObservedRunningTime="2026-09-09 17:41:04.115904612 +0000 UTC m=+44.764847419" Sep 09 17:41:05.091001 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:05.090949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6b52c" event={"ID":"3f0e91b7-fdb0-49b8-9dec-dee0b19a775e","Type":"ContainerStarted","Data":"18ee26af94cd8ad8d2667c3d9ed99a007255fc1cddf525d9231560527856c664"} Sep 09 17:41:05.110028 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:05.109975 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6b52c" podStartSLOduration=1.762958887 podStartE2EDuration="6.109939291s" totalImagesPullingTime="4.346980404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:05.109795375 +0000 UTC m=+45.758738191" watchObservedRunningTime="2026-09-09 17:41:05.109939291 +0000 UTC m=+45.758882107" Sep 09 17:41:09.108282 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:09.108242 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cb9978f7-fxcbg" event={"ID":"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d","Type":"ContainerStarted","Data":"52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf"} Sep 09 17:41:09.110169 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:09.110138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" event={"ID":"8d469c0c-ac11-4e46-b97d-2536493232a5","Type":"ContainerStarted","Data":"84bc20aee4337c3faab7c8a98342534eba0861a3fd166125f679a28cb551b9fd"} Sep 09 17:41:09.110296 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:09.110193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" event={"ID":"8d469c0c-ac11-4e46-b97d-2536493232a5","Type":"ContainerStarted","Data":"8dbbd0ee2b34dfab3b2c7379cd1ceab22bfccc65a6b5899032830e198c2973c6"} Sep 09 17:41:09.111807 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:09.111783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659b9b985-s2d5d" event={"ID":"9602ccad-2697-466c-9df4-d198de9871e7","Type":"ContainerStarted","Data":"888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce"} Sep 09 17:41:09.125855 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:09.125810 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57cb9978f7-fxcbg" podStartSLOduration=3.318868719 podStartE2EDuration="8.125797491s" totalImagesPullingTime="4.806928772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:09.124607695 +0000 UTC m=+49.773550512" watchObservedRunningTime="2026-09-09 17:41:09.125797491 +0000 UTC m=+49.774740307" Sep 09 17:41:09.144338 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:09.144291 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-c57rn" podStartSLOduration=4.322496508 podStartE2EDuration="9.144277592s" totalImagesPullingTime="4.821781084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:09.144111621 +0000 UTC m=+49.793054438" watchObservedRunningTime="2026-09-09 17:41:09.144277592 +0000 UTC m=+49.793220408" Sep 09 17:41:09.160812 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:09.160768 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659b9b985-s2d5d" podStartSLOduration=2.670750793 podStartE2EDuration="7.160743777s" totalImagesPullingTime="4.489992984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:09.159863581 +0000 UTC m=+49.808806399" watchObservedRunningTime="2026-09-09 17:41:09.160743777 +0000 UTC m=+49.809686594" Sep 09 17:41:10.728050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.728010 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd"] Sep 09 17:41:10.730441 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.730419 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.732489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.732466 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 17:41:10.732563 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.732491 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 17:41:10.732563 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.732527 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jqh7v\"" Sep 09 17:41:10.741251 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.741227 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd"] Sep 09 17:41:10.746469 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.746437 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c"] Sep 09 17:41:10.749504 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.749482 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.751149 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.751131 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sc4cp"] Sep 09 17:41:10.751695 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.751673 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 09 17:41:10.751809 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.751712 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 09 17:41:10.751809 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.751746 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 09 17:41:10.751809 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.751715 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-98nxb\"" Sep 09 17:41:10.753156 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.753136 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.754901 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.754883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 17:41:10.755042 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.754963 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gb2bm\"" Sep 09 17:41:10.755197 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.755181 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 17:41:10.755197 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.755190 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 17:41:10.758365 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.758342 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c"] Sep 09 17:41:10.784792 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.784772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.784890 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.784800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-tls\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.784890 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.784818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.784890 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.784845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-sys\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.785020 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.784904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-root\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.785020 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.784933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e57e764-728d-489a-81d3-f2c78f323c9f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.785020 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.784995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.785020 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.785136 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h52z5\" (UniqueName: \"kubernetes.io/projected/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-api-access-h52z5\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.785136 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-wtmp\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.785136 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14ea0154-0a18-416c-bf27-d9f19acde25f-metrics-client-ca\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.785136 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.785248 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.785248 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.785248 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlhwf\" (UniqueName: \"kubernetes.io/projected/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-kube-api-access-wlhwf\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.785339 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjm7\" (UniqueName: \"kubernetes.io/projected/14ea0154-0a18-416c-bf27-d9f19acde25f-kube-api-access-5rjm7\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.785339 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e57e764-728d-489a-81d3-f2c78f323c9f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.785339 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.785339 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.785333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-textfile\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.885782 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.885747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h52z5\" (UniqueName: \"kubernetes.io/projected/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-api-access-h52z5\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.885782 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.885781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-wtmp\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886061 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.885803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14ea0154-0a18-416c-bf27-d9f19acde25f-metrics-client-ca\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886061 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.885825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.886061 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.885844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886061 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.885870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.886061 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.885981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-wtmp\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886061 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlhwf\" (UniqueName: \"kubernetes.io/projected/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-kube-api-access-wlhwf\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjm7\" (UniqueName: \"kubernetes.io/projected/14ea0154-0a18-416c-bf27-d9f19acde25f-kube-api-access-5rjm7\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e57e764-728d-489a-81d3-f2c78f323c9f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-textfile\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:10.885986 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-tls\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:10.886273 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-tls podName:4e57e764-728d-489a-81d3-f2c78f323c9f nodeName:}" failed. No retries permitted until 2026-09-09 17:41:11.386252834 +0000 UTC m=+52.035195644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-rzr8c" (UID: "4e57e764-728d-489a-81d3-f2c78f323c9f") : secret "kube-state-metrics-tls" not found Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:10.886324 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 17:41:10.886362 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-sys\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:10.886382 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-tls podName:14ea0154-0a18-416c-bf27-d9f19acde25f nodeName:}" failed. No retries permitted until 2026-09-09 17:41:11.386366908 +0000 UTC m=+52.035309702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-tls") pod "node-exporter-sc4cp" (UID: "14ea0154-0a18-416c-bf27-d9f19acde25f") : secret "node-exporter-tls" not found Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-root\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886411 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-sys\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e57e764-728d-489a-81d3-f2c78f323c9f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886443 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e57e764-728d-489a-81d3-f2c78f323c9f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:10.886488 2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886505 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14ea0154-0a18-416c-bf27-d9f19acde25f-root\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:10.886533 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls podName:b2b9c5dd-a80c-4066-a4da-c2fd294074c4 nodeName:}" failed. No retries permitted until 2026-09-09 17:41:11.386514067 +0000 UTC m=+52.035456868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-n5mbd" (UID: "b2b9c5dd-a80c-4066-a4da-c2fd294074c4") : secret "openshift-state-metrics-tls" not found Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-textfile\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886605 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.886876 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.886698 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.887630 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.887098 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e57e764-728d-489a-81d3-f2c78f323c9f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.887630 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.887166 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.887630 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.887195 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14ea0154-0a18-416c-bf27-d9f19acde25f-metrics-client-ca\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.888931 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.888910 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.888931 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.888924 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.889072 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.888944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:10.896898 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.896868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlhwf\" (UniqueName: \"kubernetes.io/projected/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-kube-api-access-wlhwf\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:10.897788 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.897766 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjm7\" (UniqueName: \"kubernetes.io/projected/14ea0154-0a18-416c-bf27-d9f19acde25f-kube-api-access-5rjm7\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:10.897854 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:10.897808 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h52z5\" (UniqueName: \"kubernetes.io/projected/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-api-access-h52z5\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:11.389992 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.389938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-tls\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:11.390179 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.390001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:11.390179 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.390109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:11.390298 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:11.390181 2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 17:41:11.390298 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:11.390260 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls podName:b2b9c5dd-a80c-4066-a4da-c2fd294074c4 nodeName:}" failed. No retries permitted until 2026-09-09 17:41:12.390239855 +0000 UTC m=+53.039182669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-n5mbd" (UID: "b2b9c5dd-a80c-4066-a4da-c2fd294074c4") : secret "openshift-state-metrics-tls" not found Sep 09 17:41:11.392393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.392371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14ea0154-0a18-416c-bf27-d9f19acde25f-node-exporter-tls\") pod \"node-exporter-sc4cp\" (UID: \"14ea0154-0a18-416c-bf27-d9f19acde25f\") " pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:11.392575 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.392557 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e57e764-728d-489a-81d3-f2c78f323c9f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-rzr8c\" (UID: \"4e57e764-728d-489a-81d3-f2c78f323c9f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:11.465791 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.465757 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:11.465947 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.465821 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:11.470489 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.470467 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:11.659898 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.659817 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" Sep 09 17:41:11.665732 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.665713 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sc4cp" Sep 09 17:41:11.674512 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:11.674485 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ea0154_0a18_416c_bf27_d9f19acde25f.slice/crio-b71e204d0a5005c56fc6643882a3deff5642f81ad015e4715f7a65a1234f7f35 WatchSource:0}: Error finding container b71e204d0a5005c56fc6643882a3deff5642f81ad015e4715f7a65a1234f7f35: Status 404 returned error can't find the container with id b71e204d0a5005c56fc6643882a3deff5642f81ad015e4715f7a65a1234f7f35 Sep 09 17:41:11.933262 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:11.933190 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c"] Sep 09 17:41:11.937710 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:11.937682 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e57e764_728d_489a_81d3_f2c78f323c9f.slice/crio-9d1c4481744f2ed7cb437ddcac9f970af78f8a8b2e2c3b7ef21e5df0df5651bd WatchSource:0}: Error finding container 9d1c4481744f2ed7cb437ddcac9f970af78f8a8b2e2c3b7ef21e5df0df5651bd: Status 404 returned error can't find the container with id 9d1c4481744f2ed7cb437ddcac9f970af78f8a8b2e2c3b7ef21e5df0df5651bd Sep 09 17:41:12.122368 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:12.122335 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sc4cp" event={"ID":"14ea0154-0a18-416c-bf27-d9f19acde25f","Type":"ContainerStarted","Data":"b71e204d0a5005c56fc6643882a3deff5642f81ad015e4715f7a65a1234f7f35"} Sep 09 17:41:12.123529 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:12.123500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" event={"ID":"4e57e764-728d-489a-81d3-f2c78f323c9f","Type":"ContainerStarted","Data":"9d1c4481744f2ed7cb437ddcac9f970af78f8a8b2e2c3b7ef21e5df0df5651bd"} Sep 09 17:41:12.127325 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:12.127307 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:12.399060 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:12.399016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:12.401387 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:12.401365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2b9c5dd-a80c-4066-a4da-c2fd294074c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n5mbd\" (UID: \"b2b9c5dd-a80c-4066-a4da-c2fd294074c4\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:12.539372 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:12.539334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" Sep 09 17:41:12.811259 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:12.811054 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd"] Sep 09 17:41:12.815831 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:12.815803 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b9c5dd_a80c_4066_a4da_c2fd294074c4.slice/crio-df98e6989e8192f86d09c5d3e030e7ec0cad5bd7658046046284c64bf7f033b0 WatchSource:0}: Error finding container df98e6989e8192f86d09c5d3e030e7ec0cad5bd7658046046284c64bf7f033b0: Status 404 returned error can't find the container with id df98e6989e8192f86d09c5d3e030e7ec0cad5bd7658046046284c64bf7f033b0 Sep 09 17:41:13.128332 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:13.128257 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" event={"ID":"b2b9c5dd-a80c-4066-a4da-c2fd294074c4","Type":"ContainerStarted","Data":"a37bca4f41ec55b38ebdb93add59b48a8676f0a9d4b6f833a8199e81fbb5d6b9"} Sep 09 17:41:13.128701 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:13.128343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" event={"ID":"b2b9c5dd-a80c-4066-a4da-c2fd294074c4","Type":"ContainerStarted","Data":"1188b9af72aeeae3e8a175baf63dd3db66bca23bfbc5057a365b789d36da296b"} Sep 09 17:41:13.128701 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:13.128364 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" event={"ID":"b2b9c5dd-a80c-4066-a4da-c2fd294074c4","Type":"ContainerStarted","Data":"df98e6989e8192f86d09c5d3e030e7ec0cad5bd7658046046284c64bf7f033b0"} Sep 09 17:41:13.281260 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:13.281224 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:13.281499 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:13.281287 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:13.287242 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:13.287215 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:14.093796 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:14.093768 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7vd7b" Sep 09 17:41:14.136309 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:14.136280 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:14.180841 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:14.180815 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cb9978f7-fxcbg"] Sep 09 17:41:15.137047 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.137015 2561 generic.go:356] "Generic (PLEG): container finished" podID="14ea0154-0a18-416c-bf27-d9f19acde25f" containerID="5f7a9c6aedf02b86c1fb74647c2b24d1b6616c7cd83d532792c538b42015292a" exitCode=0 Sep 09 17:41:15.137511 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.137110 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sc4cp" event={"ID":"14ea0154-0a18-416c-bf27-d9f19acde25f","Type":"ContainerDied","Data":"5f7a9c6aedf02b86c1fb74647c2b24d1b6616c7cd83d532792c538b42015292a"} Sep 09 17:41:15.139387 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.139362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" event={"ID":"4e57e764-728d-489a-81d3-f2c78f323c9f","Type":"ContainerStarted","Data":"f926f3db20d939f9211f70b3bded0b360f99bbf82626964cc458b2a8c5bd0595"} Sep 09 17:41:15.139499 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.139417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" event={"ID":"4e57e764-728d-489a-81d3-f2c78f323c9f","Type":"ContainerStarted","Data":"27fd3c69825a2bd120fca5cc13bf175e2ac4819dac809bc20da2812fc761dc75"} Sep 09 17:41:15.139499 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.139448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" event={"ID":"4e57e764-728d-489a-81d3-f2c78f323c9f","Type":"ContainerStarted","Data":"14eeb83a1b9944c034d57ddd138d6236e904f7f801a834fdecd297c739c5e197"} Sep 09 17:41:15.143400 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.143363 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" event={"ID":"b2b9c5dd-a80c-4066-a4da-c2fd294074c4","Type":"ContainerStarted","Data":"0df10abeb3f81949b9dbf87fa5f6e6e237cadaaec21b7bc37a6c8eed5499ac72"} Sep 09 17:41:15.214908 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.214866 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n5mbd" podStartSLOduration=3.96167837 podStartE2EDuration="5.214849461s" totalImagesPullingTime="1.253171091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:15.188837596 +0000 UTC m=+55.837780413" watchObservedRunningTime="2026-09-09 17:41:15.214849461 +0000 UTC m=+55.863792276" Sep 09 17:41:15.215043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:15.214979 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-rzr8c" podStartSLOduration=2.983496954 podStartE2EDuration="5.21497311s" totalImagesPullingTime="2.231476156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:15.21380098 +0000 UTC m=+55.862743795" watchObservedRunningTime="2026-09-09 17:41:15.21497311 +0000 UTC m=+55.863915918" Sep 09 17:41:16.149413 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:16.149371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sc4cp" event={"ID":"14ea0154-0a18-416c-bf27-d9f19acde25f","Type":"ContainerStarted","Data":"bca06bb2ea02ab6f620a973ad230bcd25492fd6f5598e62bf420d2507128d541"} Sep 09 17:41:16.149854 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:16.149439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sc4cp" event={"ID":"14ea0154-0a18-416c-bf27-d9f19acde25f","Type":"ContainerStarted","Data":"969c0e3708f8fd290237c37ea65dca7c84eb0ee760907f9d09b43ad3c474479f"} Sep 09 17:41:16.170120 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:16.170076 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sc4cp" podStartSLOduration=3.555630276 podStartE2EDuration="6.170059576s" totalImagesPullingTime="2.495400172s" totalInitContainerRuntime="119.029128ms" isStatefulPod=true podCreationTimestamp="2026-09-09 17:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:16.168578019 +0000 UTC m=+56.817520834" watchObservedRunningTime="2026-09-09 17:41:16.170059576 +0000 UTC m=+56.819002391" Sep 09 17:41:17.011893 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.011858 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:41:17.043688 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.043659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.046315 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.046290 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 17:41:17.046480 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.046385 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 17:41:17.046578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.046507 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s4t42\"" Sep 09 17:41:17.046705 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.046689 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 17:41:17.046807 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.046716 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 17:41:17.046807 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.046734 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 17:41:17.047027 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.047011 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 17:41:17.047133 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.047122 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 17:41:17.047205 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.047144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 17:41:17.047280 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.047211 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e9ti834ab8tlb\"" Sep 09 17:41:17.047635 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.047612 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 17:41:17.047635 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.047630 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 17:41:17.047786 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.047679 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 17:41:17.048808 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.048754 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 17:41:17.049657 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.049633 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 17:41:17.056869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.056673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 17:41:17.062618 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.061788 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 17:41:17.063504 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.063453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:41:17.143471 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.143434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.143736 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.143714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.143867 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.143852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144006 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.143993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144143 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config-out\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144263 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144433 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-web-config\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144433 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144433 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144433 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144559 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144559 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144559 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144559 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144714 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144714 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144602 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chtdw\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-kube-api-access-chtdw\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.144714 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.144660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245445 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245445 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config-out\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-web-config\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245887 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.245995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.245937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246150 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chtdw\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-kube-api-access-chtdw\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246775 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246360 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246775 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246775 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246775 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246658 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.246985 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.246824 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.248369 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.248342 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.249663 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.249041 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.249663 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.249561 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.249830 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.249817 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config-out\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.250329 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.250263 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.250503 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.250471 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.250741 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.250714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.251204 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.251176 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.252984 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.252170 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.252984 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.252723 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.252984 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.252981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.253436 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.253414 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-web-config\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.254034 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.254015 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.254178 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.254157 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.254456 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.254440 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.260467 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.260446 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chtdw\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-kube-api-access-chtdw\") pod \"prometheus-k8s-0\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.365012 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.364891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:17.661732 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:17.661656 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:41:17.666110 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:17.666080 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841b7e4b_a22b_4de2_baa8_1a67aeebd873.slice/crio-55b233b72cac6d4387d4332e6999a65f8cfa2655718cc6f554341c88c5ab4202 WatchSource:0}: Error finding container 55b233b72cac6d4387d4332e6999a65f8cfa2655718cc6f554341c88c5ab4202: Status 404 returned error can't find the container with id 55b233b72cac6d4387d4332e6999a65f8cfa2655718cc6f554341c88c5ab4202 Sep 09 17:41:18.160487 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:18.160452 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerStarted","Data":"55b233b72cac6d4387d4332e6999a65f8cfa2655718cc6f554341c88c5ab4202"} Sep 09 17:41:19.027599 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:19.027569 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qzgs" Sep 09 17:41:19.166095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:19.166058 2561 generic.go:356] "Generic (PLEG): container finished" podID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerID="6910fcfe7cd0fc9691194bb516521cf55b2eae187a89e1075b0cf47e74722aee" exitCode=0 Sep 09 17:41:19.166232 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:19.166118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"6910fcfe7cd0fc9691194bb516521cf55b2eae187a89e1075b0cf47e74722aee"} Sep 09 17:41:22.948792 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:22.948758 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df88b5747-zpb28"] Sep 09 17:41:22.951948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:22.951929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:22.970750 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:22.970484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df88b5747-zpb28"] Sep 09 17:41:23.003276 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.003228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hcbw\" (UniqueName: \"kubernetes.io/projected/84504bd7-909f-4398-a9ac-d1cc3d931cb2-kube-api-access-8hcbw\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.003474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.003288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-serving-cert\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.003474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.003308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-oauth-config\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.003474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.003346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-trusted-ca-bundle\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.003474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.003392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-oauth-serving-cert\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.003474 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.003461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-service-ca\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.003748 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.003500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-config\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.104981 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.104919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hcbw\" (UniqueName: \"kubernetes.io/projected/84504bd7-909f-4398-a9ac-d1cc3d931cb2-kube-api-access-8hcbw\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.105189 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.105015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-serving-cert\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.105189 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.105045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-oauth-config\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.105189 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.105071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-trusted-ca-bundle\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.105189 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.105093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-oauth-serving-cert\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.105189 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.105152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-service-ca\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.105450 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.105203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-config\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.106166 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.105916 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-config\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.106835 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.106805 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-oauth-serving-cert\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.106980 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.106855 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-service-ca\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.107420 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.107392 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-trusted-ca-bundle\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.108819 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.108798 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-oauth-config\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.109125 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.109107 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-serving-cert\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.113853 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.113828 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hcbw\" (UniqueName: \"kubernetes.io/projected/84504bd7-909f-4398-a9ac-d1cc3d931cb2-kube-api-access-8hcbw\") pod \"console-6df88b5747-zpb28\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.183264 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.183220 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerStarted","Data":"ff3fc027edd47886476371483e386b545b44744800984c113a361cb68adff403"} Sep 09 17:41:23.183418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.183297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerStarted","Data":"1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0"} Sep 09 17:41:23.261587 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.261503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:23.548816 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:23.548724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df88b5747-zpb28"] Sep 09 17:41:23.552256 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:23.552228 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84504bd7_909f_4398_a9ac_d1cc3d931cb2.slice/crio-9f3816bd1a82f06b0743d9e67602d81f69f254bd2f27a334eb53a437afbef70e WatchSource:0}: Error finding container 9f3816bd1a82f06b0743d9e67602d81f69f254bd2f27a334eb53a437afbef70e: Status 404 returned error can't find the container with id 9f3816bd1a82f06b0743d9e67602d81f69f254bd2f27a334eb53a437afbef70e Sep 09 17:41:24.188950 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:24.188919 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df88b5747-zpb28" event={"ID":"84504bd7-909f-4398-a9ac-d1cc3d931cb2","Type":"ContainerStarted","Data":"5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d"} Sep 09 17:41:24.189393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:24.188981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df88b5747-zpb28" event={"ID":"84504bd7-909f-4398-a9ac-d1cc3d931cb2","Type":"ContainerStarted","Data":"9f3816bd1a82f06b0743d9e67602d81f69f254bd2f27a334eb53a437afbef70e"} Sep 09 17:41:25.195845 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.195812 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerStarted","Data":"32d4973924759642d8c8c6d45debc93dce4b5ed7220b174f46095211ada13a6f"} Sep 09 17:41:25.196211 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.195904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerStarted","Data":"87a1b3656f8bfcb187547dacdec74528aa9402acff71653d4ff3788aec75441e"} Sep 09 17:41:25.196211 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.195933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerStarted","Data":"cdf8213f4e757fa76034353548966f9c162d1a160563acb59c5126b35ecd3460"} Sep 09 17:41:25.196211 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.195973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerStarted","Data":"1ac0d33c9a9d2bdfb03685ed5fa85ace38ce9e55af2b554649e7e14cca483326"} Sep 09 17:41:25.226522 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.226462 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.880602901 podStartE2EDuration="9.226440795s" totalImagesPullingTime="6.32814411s" totalInitContainerRuntime="17.693784ms" isStatefulPod=false podCreationTimestamp="2026-09-09 17:41:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:25.224797392 +0000 UTC m=+65.873740218" watchObservedRunningTime="2026-09-09 17:41:25.226440795 +0000 UTC m=+65.875383615" Sep 09 17:41:25.227409 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.227348 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df88b5747-zpb28" podStartSLOduration=3.22733856 podStartE2EDuration="3.22733856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:24.208514509 +0000 UTC m=+64.857457337" watchObservedRunningTime="2026-09-09 17:41:25.22733856 +0000 UTC m=+65.876281387" Sep 09 17:41:25.630190 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.630101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:41:25.630190 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.630182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:41:25.632269 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.632245 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 17:41:25.632354 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.632319 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 17:41:25.643151 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.643125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d811657-ec09-4670-a288-cff11495d583-metrics-certs\") pod \"network-metrics-daemon-9c82n\" (UID: \"7d811657-ec09-4670-a288-cff11495d583\") " pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:41:25.643223 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.643125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d86b33-a0cf-462c-b284-e1672e2c7639-original-pull-secret\") pod \"global-pull-secret-syncer-l8gf9\" (UID: \"50d86b33-a0cf-462c-b284-e1672e2c7639\") " pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:41:25.731293 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.731250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:41:25.732156 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.732135 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xckm4\"" Sep 09 17:41:25.733154 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.733139 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 17:41:25.737978 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.737948 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8gf9" Sep 09 17:41:25.740010 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.739994 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9c82n" Sep 09 17:41:25.743603 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.743586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 17:41:25.755143 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:25.755118 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lw7f\" (UniqueName: \"kubernetes.io/projected/e138a63d-f237-4951-9956-f1bde324298e-kube-api-access-4lw7f\") pod \"network-check-target-rmgb6\" (UID: \"e138a63d-f237-4951-9956-f1bde324298e\") " pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:41:26.021921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:26.021897 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9c82n"] Sep 09 17:41:26.023050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:26.023027 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l8gf9"] Sep 09 17:41:26.024293 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:26.024269 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d811657_ec09_4670_a288_cff11495d583.slice/crio-15ed9e4176533cc8bc8df20c927e67fcb845bd3b4ed3125c35259bb0d120fb7e WatchSource:0}: Error finding container 15ed9e4176533cc8bc8df20c927e67fcb845bd3b4ed3125c35259bb0d120fb7e: Status 404 returned error can't find the container with id 15ed9e4176533cc8bc8df20c927e67fcb845bd3b4ed3125c35259bb0d120fb7e Sep 09 17:41:26.024884 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:26.024861 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d86b33_a0cf_462c_b284_e1672e2c7639.slice/crio-4270e5d3496ecba5e3d45fec0ae7971ebf6ad20f23fa2c4f8ada412c07275642 WatchSource:0}: Error finding container 4270e5d3496ecba5e3d45fec0ae7971ebf6ad20f23fa2c4f8ada412c07275642: Status 404 returned error can't find the container with id 4270e5d3496ecba5e3d45fec0ae7971ebf6ad20f23fa2c4f8ada412c07275642 Sep 09 17:41:26.046302 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:26.046285 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g27kw\"" Sep 09 17:41:26.055051 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:26.055034 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:41:26.201513 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:26.201481 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9c82n" event={"ID":"7d811657-ec09-4670-a288-cff11495d583","Type":"ContainerStarted","Data":"15ed9e4176533cc8bc8df20c927e67fcb845bd3b4ed3125c35259bb0d120fb7e"} Sep 09 17:41:26.202709 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:26.202683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l8gf9" event={"ID":"50d86b33-a0cf-462c-b284-e1672e2c7639","Type":"ContainerStarted","Data":"4270e5d3496ecba5e3d45fec0ae7971ebf6ad20f23fa2c4f8ada412c07275642"} Sep 09 17:41:26.325192 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:26.325128 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rmgb6"] Sep 09 17:41:26.328459 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:41:26.328434 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode138a63d_f237_4951_9956_f1bde324298e.slice/crio-c0a55e520f0015769e51c27c36ea6d239f3f51a23ac36a9835d46f585ff41b89 WatchSource:0}: Error finding container c0a55e520f0015769e51c27c36ea6d239f3f51a23ac36a9835d46f585ff41b89: Status 404 returned error can't find the container with id c0a55e520f0015769e51c27c36ea6d239f3f51a23ac36a9835d46f585ff41b89 Sep 09 17:41:27.208710 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:27.208680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9c82n" event={"ID":"7d811657-ec09-4670-a288-cff11495d583","Type":"ContainerStarted","Data":"c34b2dc335fa18206c4caa8bd8bca3c1d4a924edb41278f29df0e8fbc20ee2d9"} Sep 09 17:41:27.210076 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:27.210049 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rmgb6" event={"ID":"e138a63d-f237-4951-9956-f1bde324298e","Type":"ContainerStarted","Data":"c0a55e520f0015769e51c27c36ea6d239f3f51a23ac36a9835d46f585ff41b89"} Sep 09 17:41:27.366322 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:27.365336 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:28.223848 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:28.223790 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9c82n" event={"ID":"7d811657-ec09-4670-a288-cff11495d583","Type":"ContainerStarted","Data":"7fec559bc2ab83d679035971bfce3b9e01c659b3cde4e490d0c93bb911d67fbc"} Sep 09 17:41:28.240537 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:28.240482 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9c82n" podStartSLOduration=67.236774153 podStartE2EDuration="1m8.240462023s" totalImagesPullingTime="1.00368787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:28.238579829 +0000 UTC m=+68.887522647" watchObservedRunningTime="2026-09-09 17:41:28.240462023 +0000 UTC m=+68.889404841" Sep 09 17:41:31.238376 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:31.238275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l8gf9" event={"ID":"50d86b33-a0cf-462c-b284-e1672e2c7639","Type":"ContainerStarted","Data":"b4246ce1e811235e915c726e104c66f0c74461c60e9443b1651c1bda2b45f0a3"} Sep 09 17:41:31.239790 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:31.239764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rmgb6" event={"ID":"e138a63d-f237-4951-9956-f1bde324298e","Type":"ContainerStarted","Data":"642a366f525f0233173486adbe56cc0d74ae6f0e9e4eb1dd63f650638d6d57a7"} Sep 09 17:41:31.239971 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:31.239942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:41:31.254214 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:31.254172 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l8gf9" podStartSLOduration=66.306846229 podStartE2EDuration="1m11.254158147s" totalImagesPullingTime="4.947311918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:31.253541874 +0000 UTC m=+71.902484691" watchObservedRunningTime="2026-09-09 17:41:31.254158147 +0000 UTC m=+71.903100962" Sep 09 17:41:31.269594 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:31.269558 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rmgb6" podStartSLOduration=66.626357386 podStartE2EDuration="1m11.269544966s" totalImagesPullingTime="4.64318758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:41:31.268916269 +0000 UTC m=+71.917859085" watchObservedRunningTime="2026-09-09 17:41:31.269544966 +0000 UTC m=+71.918487784" Sep 09 17:41:33.262445 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:33.262412 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:33.262901 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:33.262501 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:33.267121 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:33.267099 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:34.253787 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:34.253758 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:41:34.301879 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:34.301849 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659b9b985-s2d5d"] Sep 09 17:41:39.203703 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.203656 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57cb9978f7-fxcbg" podUID="c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" containerName="console" containerID="cri-o://52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf" gracePeriod=15 Sep 09 17:41:39.444374 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.444350 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:39.555324 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555230 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-config\") pod \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " Sep 09 17:41:39.555324 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555296 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-oauth-serving-cert\") pod \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " Sep 09 17:41:39.555324 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555319 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7csz\" (UniqueName: \"kubernetes.io/projected/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-kube-api-access-n7csz\") pod \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " Sep 09 17:41:39.555591 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555382 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-serving-cert\") pod \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " Sep 09 17:41:39.555591 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555406 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-service-ca\") pod \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " Sep 09 17:41:39.555591 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555437 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-oauth-config\") pod \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\" (UID: \"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d\") " Sep 09 17:41:39.555736 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555694 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-config" (OuterVolumeSpecName: "console-config") pod "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" (UID: "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:41:39.555791 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555733 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" (UID: "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:41:39.555861 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.555831 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-service-ca" (OuterVolumeSpecName: "service-ca") pod "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" (UID: "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:41:39.557726 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.557699 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" (UID: "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:41:39.557829 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.557746 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-kube-api-access-n7csz" (OuterVolumeSpecName: "kube-api-access-n7csz") pod "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" (UID: "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d"). InnerVolumeSpecName "kube-api-access-n7csz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 17:41:39.557829 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.557746 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" (UID: "c332827c-5b60-4a45-9a7e-ce8fc0dcc34d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:41:39.656124 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.656077 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-serving-cert\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:39.656124 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.656118 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-service-ca\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:39.656124 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.656128 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-oauth-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:39.656124 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.656136 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-console-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:39.656124 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.656144 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-oauth-serving-cert\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:39.656410 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:39.656152 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7csz\" (UniqueName: \"kubernetes.io/projected/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d-kube-api-access-n7csz\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:40.278304 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.278271 2561 generic.go:356] "Generic (PLEG): container finished" podID="c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" containerID="52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf" exitCode=0 Sep 09 17:41:40.278703 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.278312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cb9978f7-fxcbg" event={"ID":"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d","Type":"ContainerDied","Data":"52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf"} Sep 09 17:41:40.278703 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.278347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cb9978f7-fxcbg" event={"ID":"c332827c-5b60-4a45-9a7e-ce8fc0dcc34d","Type":"ContainerDied","Data":"57841e89b7efc3666d05612d87eb7570caaa03eacb7573d1e4512b2f4f8b9c22"} Sep 09 17:41:40.278703 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.278366 2561 scope.go:117] "RemoveContainer" containerID="52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf" Sep 09 17:41:40.278703 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.278313 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cb9978f7-fxcbg" Sep 09 17:41:40.286344 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.286329 2561 scope.go:117] "RemoveContainer" containerID="52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf" Sep 09 17:41:40.286622 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:41:40.286602 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf\": container with ID starting with 52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf not found: ID does not exist" containerID="52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf" Sep 09 17:41:40.286673 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.286632 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf"} err="failed to get container status \"52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf\": rpc error: code = NotFound desc = could not find container \"52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf\": container with ID starting with 52422292f7245214c6f131ac96f1ef08157b82d65c719646819bdd7da62afdbf not found: ID does not exist" Sep 09 17:41:40.292348 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.292328 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cb9978f7-fxcbg"] Sep 09 17:41:40.298548 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:40.298522 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57cb9978f7-fxcbg"] Sep 09 17:41:41.822066 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:41.822033 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" path="/var/lib/kubelet/pods/c332827c-5b60-4a45-9a7e-ce8fc0dcc34d/volumes" Sep 09 17:41:46.207346 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:46.207283 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:46.226565 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:46.226541 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:46.315680 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:46.315654 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:41:59.325603 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.325555 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-659b9b985-s2d5d" podUID="9602ccad-2697-466c-9df4-d198de9871e7" containerName="console" containerID="cri-o://888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce" gracePeriod=15 Sep 09 17:41:59.565699 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.565676 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:41:59.617176 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617099 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-oauth-serving-cert\") pod \"9602ccad-2697-466c-9df4-d198de9871e7\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " Sep 09 17:41:59.617176 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617144 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zs25\" (UniqueName: \"kubernetes.io/projected/9602ccad-2697-466c-9df4-d198de9871e7-kube-api-access-7zs25\") pod \"9602ccad-2697-466c-9df4-d198de9871e7\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " Sep 09 17:41:59.617373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617197 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-service-ca\") pod \"9602ccad-2697-466c-9df4-d198de9871e7\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " Sep 09 17:41:59.617373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617235 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-trusted-ca-bundle\") pod \"9602ccad-2697-466c-9df4-d198de9871e7\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " Sep 09 17:41:59.617373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617262 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-oauth-config\") pod \"9602ccad-2697-466c-9df4-d198de9871e7\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " Sep 09 17:41:59.617373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617297 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-serving-cert\") pod \"9602ccad-2697-466c-9df4-d198de9871e7\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " Sep 09 17:41:59.617373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617334 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-console-config\") pod \"9602ccad-2697-466c-9df4-d198de9871e7\" (UID: \"9602ccad-2697-466c-9df4-d198de9871e7\") " Sep 09 17:41:59.617641 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617509 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9602ccad-2697-466c-9df4-d198de9871e7" (UID: "9602ccad-2697-466c-9df4-d198de9871e7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:41:59.617711 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617673 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-service-ca" (OuterVolumeSpecName: "service-ca") pod "9602ccad-2697-466c-9df4-d198de9871e7" (UID: "9602ccad-2697-466c-9df4-d198de9871e7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:41:59.617782 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617751 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9602ccad-2697-466c-9df4-d198de9871e7" (UID: "9602ccad-2697-466c-9df4-d198de9871e7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:41:59.617878 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.617856 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-console-config" (OuterVolumeSpecName: "console-config") pod "9602ccad-2697-466c-9df4-d198de9871e7" (UID: "9602ccad-2697-466c-9df4-d198de9871e7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:41:59.619429 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.619407 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9602ccad-2697-466c-9df4-d198de9871e7" (UID: "9602ccad-2697-466c-9df4-d198de9871e7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:41:59.619944 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.619914 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9602ccad-2697-466c-9df4-d198de9871e7" (UID: "9602ccad-2697-466c-9df4-d198de9871e7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:41:59.620028 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.619949 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9602ccad-2697-466c-9df4-d198de9871e7-kube-api-access-7zs25" (OuterVolumeSpecName: "kube-api-access-7zs25") pod "9602ccad-2697-466c-9df4-d198de9871e7" (UID: "9602ccad-2697-466c-9df4-d198de9871e7"). InnerVolumeSpecName "kube-api-access-7zs25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 17:41:59.718181 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.718153 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-oauth-serving-cert\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:59.718181 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.718177 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zs25\" (UniqueName: \"kubernetes.io/projected/9602ccad-2697-466c-9df4-d198de9871e7-kube-api-access-7zs25\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:59.718326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.718190 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-service-ca\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:59.718326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.718202 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-trusted-ca-bundle\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:59.718326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.718213 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-oauth-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:59.718326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.718225 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9602ccad-2697-466c-9df4-d198de9871e7-console-serving-cert\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:41:59.718326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:41:59.718236 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9602ccad-2697-466c-9df4-d198de9871e7-console-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:00.356573 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.356540 2561 generic.go:356] "Generic (PLEG): container finished" podID="9602ccad-2697-466c-9df4-d198de9871e7" containerID="888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce" exitCode=0 Sep 09 17:42:00.356933 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.356588 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659b9b985-s2d5d" Sep 09 17:42:00.356933 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.356590 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659b9b985-s2d5d" event={"ID":"9602ccad-2697-466c-9df4-d198de9871e7","Type":"ContainerDied","Data":"888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce"} Sep 09 17:42:00.356933 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.356706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659b9b985-s2d5d" event={"ID":"9602ccad-2697-466c-9df4-d198de9871e7","Type":"ContainerDied","Data":"037b1c8916feea00036f3dd6e6e60f81726f9bc25a34f3d00be45a459921642f"} Sep 09 17:42:00.356933 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.356733 2561 scope.go:117] "RemoveContainer" containerID="888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce" Sep 09 17:42:00.364317 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.364299 2561 scope.go:117] "RemoveContainer" containerID="888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce" Sep 09 17:42:00.364585 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:42:00.364566 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce\": container with ID starting with 888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce not found: ID does not exist" containerID="888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce" Sep 09 17:42:00.364646 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.364593 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce"} err="failed to get container status \"888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce\": rpc error: code = NotFound desc = could not find container \"888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce\": container with ID starting with 888dd10611e0230e6e2415d13072ffa677356b1cef41bdbbb26e7a17c2869dce not found: ID does not exist" Sep 09 17:42:00.373091 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.373071 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659b9b985-s2d5d"] Sep 09 17:42:00.376620 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:00.376599 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-659b9b985-s2d5d"] Sep 09 17:42:01.827421 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:01.827384 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9602ccad-2697-466c-9df4-d198de9871e7" path="/var/lib/kubelet/pods/9602ccad-2697-466c-9df4-d198de9871e7/volumes" Sep 09 17:42:02.245980 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:02.245934 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rmgb6" Sep 09 17:42:04.734069 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:04.734030 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:42:04.734629 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:04.734336 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="prometheus" containerID="cri-o://1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0" gracePeriod=600 Sep 09 17:42:04.734629 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:04.734370 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="thanos-sidecar" containerID="cri-o://1ac0d33c9a9d2bdfb03685ed5fa85ace38ce9e55af2b554649e7e14cca483326" gracePeriod=600 Sep 09 17:42:04.734629 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:04.734386 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-web" containerID="cri-o://cdf8213f4e757fa76034353548966f9c162d1a160563acb59c5126b35ecd3460" gracePeriod=600 Sep 09 17:42:04.734629 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:04.734475 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-thanos" containerID="cri-o://32d4973924759642d8c8c6d45debc93dce4b5ed7220b174f46095211ada13a6f" gracePeriod=600 Sep 09 17:42:04.734629 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:04.734499 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="config-reloader" containerID="cri-o://ff3fc027edd47886476371483e386b545b44744800984c113a361cb68adff403" gracePeriod=600 Sep 09 17:42:04.734629 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:04.734510 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy" containerID="cri-o://87a1b3656f8bfcb187547dacdec74528aa9402acff71653d4ff3788aec75441e" gracePeriod=600 Sep 09 17:42:05.378777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378744 2561 generic.go:356] "Generic (PLEG): container finished" podID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerID="32d4973924759642d8c8c6d45debc93dce4b5ed7220b174f46095211ada13a6f" exitCode=0 Sep 09 17:42:05.378777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378771 2561 generic.go:356] "Generic (PLEG): container finished" podID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerID="87a1b3656f8bfcb187547dacdec74528aa9402acff71653d4ff3788aec75441e" exitCode=0 Sep 09 17:42:05.378777 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378782 2561 generic.go:356] "Generic (PLEG): container finished" podID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerID="1ac0d33c9a9d2bdfb03685ed5fa85ace38ce9e55af2b554649e7e14cca483326" exitCode=0 Sep 09 17:42:05.379090 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378789 2561 generic.go:356] "Generic (PLEG): container finished" podID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerID="ff3fc027edd47886476371483e386b545b44744800984c113a361cb68adff403" exitCode=0 Sep 09 17:42:05.379090 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378795 2561 generic.go:356] "Generic (PLEG): container finished" podID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerID="1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0" exitCode=0 Sep 09 17:42:05.379090 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378816 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"32d4973924759642d8c8c6d45debc93dce4b5ed7220b174f46095211ada13a6f"} Sep 09 17:42:05.379090 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378892 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"87a1b3656f8bfcb187547dacdec74528aa9402acff71653d4ff3788aec75441e"} Sep 09 17:42:05.379090 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"1ac0d33c9a9d2bdfb03685ed5fa85ace38ce9e55af2b554649e7e14cca483326"} Sep 09 17:42:05.379090 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.378986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"ff3fc027edd47886476371483e386b545b44744800984c113a361cb68adff403"} Sep 09 17:42:05.379090 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:05.379027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0"} Sep 09 17:42:06.300884 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:42:06.300842 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0 is running failed: container process not found" containerID="1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 09 17:42:06.301319 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:42:06.301234 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0 is running failed: container process not found" containerID="1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 09 17:42:06.301590 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:42:06.301560 2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0 is running failed: container process not found" containerID="1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 09 17:42:06.301662 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:42:06.301604 2561 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0 is running failed: container process not found" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="prometheus" probeResult="unknown" Sep 09 17:42:06.390499 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.390354 2561 generic.go:356] "Generic (PLEG): container finished" podID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerID="cdf8213f4e757fa76034353548966f9c162d1a160563acb59c5126b35ecd3460" exitCode=0 Sep 09 17:42:06.390499 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.390417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"cdf8213f4e757fa76034353548966f9c162d1a160563acb59c5126b35ecd3460"} Sep 09 17:42:06.521278 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.521174 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:06.576566 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576473 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576566 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576528 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-tls\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576566 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576561 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-1\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576586 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-2\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576614 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chtdw\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-kube-api-access-chtdw\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576634 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-serving-certs-ca-bundle\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576677 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-web-config\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576700 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-metrics-client-certs\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576724 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-grpc-tls\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576764 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-metrics-client-ca\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576798 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-thanos-prometheus-http-client-file\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.576836 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576836 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-db\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576864 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576896 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-0\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576927 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config-out\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.576985 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-kubelet-serving-ca-bundle\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.577014 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-kube-rbac-proxy\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.577048 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.577057 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:06.577300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.577088 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-trusted-ca-bundle\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.577686 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.577417 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:06.579049 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.578472 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-tls-assets\") pod \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\" (UID: \"841b7e4b-a22b-4de2-baa8-1a67aeebd873\") " Sep 09 17:42:06.579049 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.578693 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:06.579049 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.578705 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.579049 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.578723 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.581021 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.580691 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:06.581021 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.580837 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:06.581678 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.581117 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:06.581678 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.581580 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config" (OuterVolumeSpecName: "config") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.582714 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.582662 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 17:42:06.582931 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.582907 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:06.583273 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.583250 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.583722 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.583689 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.586043 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.585005 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.587381 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.587348 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.587716 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.587688 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.587936 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.587908 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 17:42:06.588284 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.588253 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.589566 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.589507 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.589675 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.589559 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-kube-api-access-chtdw" (OuterVolumeSpecName: "kube-api-access-chtdw") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "kube-api-access-chtdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 17:42:06.589675 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.589582 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config-out" (OuterVolumeSpecName: "config-out") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 17:42:06.596975 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.596929 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-web-config" (OuterVolumeSpecName: "web-config") pod "841b7e4b-a22b-4de2-baa8-1a67aeebd873" (UID: "841b7e4b-a22b-4de2-baa8-1a67aeebd873"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:06.679328 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679290 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-tls-assets\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679328 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679325 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679328 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679337 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679345 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679354 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chtdw\" (UniqueName: \"kubernetes.io/projected/841b7e4b-a22b-4de2-baa8-1a67aeebd873-kube-api-access-chtdw\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679363 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679372 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-web-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679381 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-metrics-client-certs\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679388 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-grpc-tls\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679397 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-metrics-client-ca\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679405 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679413 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-db\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679424 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679433 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679440 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/841b7e4b-a22b-4de2-baa8-1a67aeebd873-config-out\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679448 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841b7e4b-a22b-4de2-baa8-1a67aeebd873-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679457 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-kube-rbac-proxy\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:06.679593 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:06.679465 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/841b7e4b-a22b-4de2-baa8-1a67aeebd873-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:07.402247 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.402214 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"841b7e4b-a22b-4de2-baa8-1a67aeebd873","Type":"ContainerDied","Data":"55b233b72cac6d4387d4332e6999a65f8cfa2655718cc6f554341c88c5ab4202"} Sep 09 17:42:07.402671 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.402269 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.402671 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.402333 2561 scope.go:117] "RemoveContainer" containerID="32d4973924759642d8c8c6d45debc93dce4b5ed7220b174f46095211ada13a6f" Sep 09 17:42:07.410578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.410448 2561 scope.go:117] "RemoveContainer" containerID="87a1b3656f8bfcb187547dacdec74528aa9402acff71653d4ff3788aec75441e" Sep 09 17:42:07.422216 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.419011 2561 scope.go:117] "RemoveContainer" containerID="cdf8213f4e757fa76034353548966f9c162d1a160563acb59c5126b35ecd3460" Sep 09 17:42:07.429014 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.426773 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:42:07.431494 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.431469 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:42:07.434736 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.434722 2561 scope.go:117] "RemoveContainer" containerID="1ac0d33c9a9d2bdfb03685ed5fa85ace38ce9e55af2b554649e7e14cca483326" Sep 09 17:42:07.442190 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.442168 2561 scope.go:117] "RemoveContainer" containerID="ff3fc027edd47886476371483e386b545b44744800984c113a361cb68adff403" Sep 09 17:42:07.452201 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.452179 2561 scope.go:117] "RemoveContainer" containerID="1a6fbd8e1c9234ceef56afa2dfc2c5053341f931c1799a1d449e3686dc32c6f0" Sep 09 17:42:07.454534 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454513 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:42:07.454818 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454800 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="config-reloader" Sep 09 17:42:07.454818 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454818 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="config-reloader" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454828 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9602ccad-2697-466c-9df4-d198de9871e7" containerName="console" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454834 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9602ccad-2697-466c-9df4-d198de9871e7" containerName="console" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454841 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" containerName="console" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454847 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" containerName="console" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454859 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-web" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454867 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-web" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454877 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454884 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454899 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-thanos" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454903 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-thanos" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454911 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="init-config-reloader" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454916 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="init-config-reloader" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454922 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="prometheus" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454931 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="prometheus" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454939 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="thanos-sidecar" Sep 09 17:42:07.454948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.454946 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="thanos-sidecar" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455028 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-thanos" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455040 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455050 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9602ccad-2697-466c-9df4-d198de9871e7" containerName="console" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455061 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="thanos-sidecar" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455070 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c332827c-5b60-4a45-9a7e-ce8fc0dcc34d" containerName="console" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455077 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="prometheus" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455086 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="kube-rbac-proxy-web" Sep 09 17:42:07.455623 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.455096 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" containerName="config-reloader" Sep 09 17:42:07.459451 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.459431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.461447 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.461425 2561 scope.go:117] "RemoveContainer" containerID="6910fcfe7cd0fc9691194bb516521cf55b2eae187a89e1075b0cf47e74722aee" Sep 09 17:42:07.461697 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.461678 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 17:42:07.461972 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.461934 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 17:42:07.462083 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.461987 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 17:42:07.462083 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.461990 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e9ti834ab8tlb\"" Sep 09 17:42:07.462194 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462133 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 17:42:07.462194 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462185 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 17:42:07.462298 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462207 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 17:42:07.462298 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462255 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 17:42:07.462466 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462437 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s4t42\"" Sep 09 17:42:07.463062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462605 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 17:42:07.463062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462647 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 17:42:07.463062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 17:42:07.463062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462712 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 17:42:07.463062 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.462646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 17:42:07.464269 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.463443 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 17:42:07.467032 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.467012 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 17:42:07.470426 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.468444 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 17:42:07.473870 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.473842 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:42:07.586037 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586180 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586180 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586180 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/295ee992-40d3-4e32-9a9a-fabae1921b33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586180 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586365 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586365 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586365 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-web-config\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586365 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586365 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-config\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/295ee992-40d3-4e32-9a9a-fabae1921b33-config-out\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586578 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586612 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.586758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.586681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2jj8\" (UniqueName: \"kubernetes.io/projected/295ee992-40d3-4e32-9a9a-fabae1921b33-kube-api-access-q2jj8\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.687725 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.687895 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.687895 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-web-config\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.687895 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.687895 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.687895 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.687947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-config\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/295ee992-40d3-4e32-9a9a-fabae1921b33-config-out\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688226 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2jj8\" (UniqueName: \"kubernetes.io/projected/295ee992-40d3-4e32-9a9a-fabae1921b33-kube-api-access-q2jj8\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688682 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688682 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688682 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688682 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/295ee992-40d3-4e32-9a9a-fabae1921b33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688682 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.688942 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.688797 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.691038 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.690058 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.691038 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.690142 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.691224 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.691081 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.692648 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.692314 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.700275 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.695070 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.700275 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.695554 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.700275 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.696210 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.700275 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.697623 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.700275 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.699444 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.700275 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.699945 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/295ee992-40d3-4e32-9a9a-fabae1921b33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.705310 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.702499 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-config\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.705310 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.703185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2jj8\" (UniqueName: \"kubernetes.io/projected/295ee992-40d3-4e32-9a9a-fabae1921b33-kube-api-access-q2jj8\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.705310 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.703821 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-web-config\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.705310 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.704476 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.705310 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.704882 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.705624 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.705566 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/295ee992-40d3-4e32-9a9a-fabae1921b33-config-out\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.705888 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.705865 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.706741 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.706718 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/295ee992-40d3-4e32-9a9a-fabae1921b33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.707295 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.707276 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/295ee992-40d3-4e32-9a9a-fabae1921b33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"295ee992-40d3-4e32-9a9a-fabae1921b33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.776356 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.776318 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:07.823442 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:07.823407 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841b7e4b-a22b-4de2-baa8-1a67aeebd873" path="/var/lib/kubelet/pods/841b7e4b-a22b-4de2-baa8-1a67aeebd873/volumes" Sep 09 17:42:08.073425 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:08.073354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 17:42:08.077285 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:42:08.077260 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295ee992_40d3_4e32_9a9a_fabae1921b33.slice/crio-a6e12d1e07d90651ab3406a24df7813526c550932d27221695d3120c7888be55 WatchSource:0}: Error finding container a6e12d1e07d90651ab3406a24df7813526c550932d27221695d3120c7888be55: Status 404 returned error can't find the container with id a6e12d1e07d90651ab3406a24df7813526c550932d27221695d3120c7888be55 Sep 09 17:42:08.407921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:08.407835 2561 generic.go:356] "Generic (PLEG): container finished" podID="295ee992-40d3-4e32-9a9a-fabae1921b33" containerID="a6f9ecb4d8ecb5e413a079e78518e0830a4f5c7e530d84f61d3ee0bb88b44abb" exitCode=0 Sep 09 17:42:08.407921 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:08.407872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerDied","Data":"a6f9ecb4d8ecb5e413a079e78518e0830a4f5c7e530d84f61d3ee0bb88b44abb"} Sep 09 17:42:08.408315 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:08.407950 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerStarted","Data":"a6e12d1e07d90651ab3406a24df7813526c550932d27221695d3120c7888be55"} Sep 09 17:42:09.011589 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.011553 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df88b5747-zpb28"] Sep 09 17:42:09.415585 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.415506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerStarted","Data":"4f00acb50e4b30aef32342f0c37f357a82ccaf1de2d0bceed9f3e894db80c57c"} Sep 09 17:42:09.415585 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.415569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerStarted","Data":"839eb4ec93f732b7f9f29b98d3274b3f9df0b615935b8d9b5356a7377cc73b26"} Sep 09 17:42:09.415988 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.415597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerStarted","Data":"67375dc4b4d8a6d1c1dd2917f2997e1737cd976dcefbff34736fe6db610934f0"} Sep 09 17:42:09.415988 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.415622 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerStarted","Data":"ef841944d90c8480cbd2e7bd270a436a17edf994e7833b03933b40d343ad424f"} Sep 09 17:42:09.415988 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.415644 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerStarted","Data":"a6988ec31b2a7e23f4de1d92d3c68ec691e766c7fbfde3f902e33c13c949b00b"} Sep 09 17:42:09.415988 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.415665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"295ee992-40d3-4e32-9a9a-fabae1921b33","Type":"ContainerStarted","Data":"39cd2109333929004cde4d3300c00971958bc615df689b81576643eabe5b01d6"} Sep 09 17:42:09.442190 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:09.442128 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.410292322 podStartE2EDuration="2.442107953s" totalImagesPullingTime="0s" totalInitContainerRuntime="31.815631ms" isStatefulPod=false podCreationTimestamp="2026-09-09 17:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:42:09.440832415 +0000 UTC m=+110.089775242" watchObservedRunningTime="2026-09-09 17:42:09.442107953 +0000 UTC m=+110.091050777" Sep 09 17:42:12.776929 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:12.776897 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:42:34.030079 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.030018 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6df88b5747-zpb28" podUID="84504bd7-909f-4398-a9ac-d1cc3d931cb2" containerName="console" containerID="cri-o://5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d" gracePeriod=15 Sep 09 17:42:34.262003 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.261979 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:42:34.411472 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411400 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hcbw\" (UniqueName: \"kubernetes.io/projected/84504bd7-909f-4398-a9ac-d1cc3d931cb2-kube-api-access-8hcbw\") pod \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " Sep 09 17:42:34.411472 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411443 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-service-ca\") pod \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " Sep 09 17:42:34.411674 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411492 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-oauth-serving-cert\") pod \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " Sep 09 17:42:34.411674 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411524 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-trusted-ca-bundle\") pod \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " Sep 09 17:42:34.411674 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411544 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-serving-cert\") pod \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " Sep 09 17:42:34.411674 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411638 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-oauth-config\") pod \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " Sep 09 17:42:34.411867 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411683 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-config\") pod \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\" (UID: \"84504bd7-909f-4398-a9ac-d1cc3d931cb2\") " Sep 09 17:42:34.412085 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411940 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-service-ca" (OuterVolumeSpecName: "service-ca") pod "84504bd7-909f-4398-a9ac-d1cc3d931cb2" (UID: "84504bd7-909f-4398-a9ac-d1cc3d931cb2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:34.412085 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.411975 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84504bd7-909f-4398-a9ac-d1cc3d931cb2" (UID: "84504bd7-909f-4398-a9ac-d1cc3d931cb2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:34.412085 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.412069 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-config" (OuterVolumeSpecName: "console-config") pod "84504bd7-909f-4398-a9ac-d1cc3d931cb2" (UID: "84504bd7-909f-4398-a9ac-d1cc3d931cb2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:34.412259 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.412161 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84504bd7-909f-4398-a9ac-d1cc3d931cb2" (UID: "84504bd7-909f-4398-a9ac-d1cc3d931cb2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 17:42:34.413739 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.413714 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84504bd7-909f-4398-a9ac-d1cc3d931cb2-kube-api-access-8hcbw" (OuterVolumeSpecName: "kube-api-access-8hcbw") pod "84504bd7-909f-4398-a9ac-d1cc3d931cb2" (UID: "84504bd7-909f-4398-a9ac-d1cc3d931cb2"). InnerVolumeSpecName "kube-api-access-8hcbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 17:42:34.413831 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.413730 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84504bd7-909f-4398-a9ac-d1cc3d931cb2" (UID: "84504bd7-909f-4398-a9ac-d1cc3d931cb2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:34.413831 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.413783 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84504bd7-909f-4398-a9ac-d1cc3d931cb2" (UID: "84504bd7-909f-4398-a9ac-d1cc3d931cb2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 17:42:34.512232 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512204 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-oauth-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:34.512232 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512227 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-config\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:34.512232 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512240 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hcbw\" (UniqueName: \"kubernetes.io/projected/84504bd7-909f-4398-a9ac-d1cc3d931cb2-kube-api-access-8hcbw\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:34.512470 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512253 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-service-ca\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:34.512470 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512262 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-oauth-serving-cert\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:34.512470 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512269 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84504bd7-909f-4398-a9ac-d1cc3d931cb2-trusted-ca-bundle\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:34.512470 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512278 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84504bd7-909f-4398-a9ac-d1cc3d931cb2-console-serving-cert\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:42:34.513013 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.512992 2561 generic.go:356] "Generic (PLEG): container finished" podID="84504bd7-909f-4398-a9ac-d1cc3d931cb2" containerID="5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d" exitCode=0 Sep 09 17:42:34.513082 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.513042 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df88b5747-zpb28" Sep 09 17:42:34.513082 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.513073 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df88b5747-zpb28" event={"ID":"84504bd7-909f-4398-a9ac-d1cc3d931cb2","Type":"ContainerDied","Data":"5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d"} Sep 09 17:42:34.513145 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.513112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df88b5747-zpb28" event={"ID":"84504bd7-909f-4398-a9ac-d1cc3d931cb2","Type":"ContainerDied","Data":"9f3816bd1a82f06b0743d9e67602d81f69f254bd2f27a334eb53a437afbef70e"} Sep 09 17:42:34.513145 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.513133 2561 scope.go:117] "RemoveContainer" containerID="5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d" Sep 09 17:42:34.521502 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.521482 2561 scope.go:117] "RemoveContainer" containerID="5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d" Sep 09 17:42:34.521760 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:42:34.521737 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d\": container with ID starting with 5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d not found: ID does not exist" containerID="5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d" Sep 09 17:42:34.521815 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.521769 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d"} err="failed to get container status \"5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d\": rpc error: code = NotFound desc = could not find container \"5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d\": container with ID starting with 5434c56be58f15191c13af83ae6323338dc4bad75291903dcb460163a9862a5d not found: ID does not exist" Sep 09 17:42:34.534037 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.534015 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df88b5747-zpb28"] Sep 09 17:42:34.538482 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:34.538462 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df88b5747-zpb28"] Sep 09 17:42:35.251231 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:35.251193 2561 patch_prober.go:28] interesting pod/console-6df88b5747-zpb28 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.15:8443/health\": context deadline exceeded" start-of-body= Sep 09 17:42:35.251574 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:35.251255 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6df88b5747-zpb28" podUID="84504bd7-909f-4398-a9ac-d1cc3d931cb2" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": context deadline exceeded" Sep 09 17:42:35.821232 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:42:35.821203 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84504bd7-909f-4398-a9ac-d1cc3d931cb2" path="/var/lib/kubelet/pods/84504bd7-909f-4398-a9ac-d1cc3d931cb2/volumes" Sep 09 17:43:07.777055 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:07.777000 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:43:07.792127 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:07.792100 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:43:08.649730 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:08.649702 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 17:43:52.625727 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.625685 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pbphv"] Sep 09 17:43:52.626333 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.626085 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84504bd7-909f-4398-a9ac-d1cc3d931cb2" containerName="console" Sep 09 17:43:52.626333 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.626104 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="84504bd7-909f-4398-a9ac-d1cc3d931cb2" containerName="console" Sep 09 17:43:52.626333 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.626176 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="84504bd7-909f-4398-a9ac-d1cc3d931cb2" containerName="console" Sep 09 17:43:52.629060 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.629039 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:52.631106 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.631085 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-62tw8\"" Sep 09 17:43:52.631661 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.631641 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 17:43:52.631742 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.631691 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 17:43:52.642191 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.642167 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pbphv"] Sep 09 17:43:52.803174 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.803142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8p5t\" (UniqueName: \"kubernetes.io/projected/edb8754d-5499-4b30-8bb3-e016a70d4a67-kube-api-access-d8p5t\") pod \"cert-manager-cainjector-559cdd8c87-pbphv\" (UID: \"edb8754d-5499-4b30-8bb3-e016a70d4a67\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:52.803335 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.803186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edb8754d-5499-4b30-8bb3-e016a70d4a67-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pbphv\" (UID: \"edb8754d-5499-4b30-8bb3-e016a70d4a67\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:52.903981 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.903880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edb8754d-5499-4b30-8bb3-e016a70d4a67-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pbphv\" (UID: \"edb8754d-5499-4b30-8bb3-e016a70d4a67\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:52.903981 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.903969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8p5t\" (UniqueName: \"kubernetes.io/projected/edb8754d-5499-4b30-8bb3-e016a70d4a67-kube-api-access-d8p5t\") pod \"cert-manager-cainjector-559cdd8c87-pbphv\" (UID: \"edb8754d-5499-4b30-8bb3-e016a70d4a67\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:52.911370 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.911349 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edb8754d-5499-4b30-8bb3-e016a70d4a67-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pbphv\" (UID: \"edb8754d-5499-4b30-8bb3-e016a70d4a67\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:52.911480 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.911404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8p5t\" (UniqueName: \"kubernetes.io/projected/edb8754d-5499-4b30-8bb3-e016a70d4a67-kube-api-access-d8p5t\") pod \"cert-manager-cainjector-559cdd8c87-pbphv\" (UID: \"edb8754d-5499-4b30-8bb3-e016a70d4a67\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:52.952373 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:52.952343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" Sep 09 17:43:54.770008 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:54.769971 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pbphv"] Sep 09 17:43:54.773029 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:43:54.773005 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedb8754d_5499_4b30_8bb3_e016a70d4a67.slice/crio-92525089d6c4e91a734d44c7e2ac9918cbf390ad5ce7b51cda22aca93d0612cf WatchSource:0}: Error finding container 92525089d6c4e91a734d44c7e2ac9918cbf390ad5ce7b51cda22aca93d0612cf: Status 404 returned error can't find the container with id 92525089d6c4e91a734d44c7e2ac9918cbf390ad5ce7b51cda22aca93d0612cf Sep 09 17:43:54.798219 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:54.798190 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" event={"ID":"edb8754d-5499-4b30-8bb3-e016a70d4a67","Type":"ContainerStarted","Data":"92525089d6c4e91a734d44c7e2ac9918cbf390ad5ce7b51cda22aca93d0612cf"} Sep 09 17:43:58.815802 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:58.815764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" event={"ID":"edb8754d-5499-4b30-8bb3-e016a70d4a67","Type":"ContainerStarted","Data":"06416779d65fd591a96f9aa2cf779118be142cc70c8e1fcf50f081463add8881"} Sep 09 17:43:58.830812 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:58.830769 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pbphv" podStartSLOduration=3.852940716 podStartE2EDuration="6.830755418s" totalImagesPullingTime="2.977814702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:43:58.829485986 +0000 UTC m=+219.478428802" watchObservedRunningTime="2026-09-09 17:43:58.830755418 +0000 UTC m=+219.479698233" Sep 09 17:43:59.463060 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.463023 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm"] Sep 09 17:43:59.466171 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.466154 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:43:59.468246 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.468226 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 17:43:59.468846 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.468823 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9g4qg\"" Sep 09 17:43:59.468971 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.468861 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 17:43:59.473996 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.473939 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm"] Sep 09 17:43:59.556940 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.556914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-652c4\" (UniqueName: \"kubernetes.io/projected/c38c339a-9d7a-4e28-b468-3cc25e37c751-kube-api-access-652c4\") pod \"openshift-lws-operator-fd8ccff4c-8mgkm\" (UID: \"c38c339a-9d7a-4e28-b468-3cc25e37c751\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:43:59.557135 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.557042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c38c339a-9d7a-4e28-b468-3cc25e37c751-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8mgkm\" (UID: \"c38c339a-9d7a-4e28-b468-3cc25e37c751\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:43:59.658256 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.658218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-652c4\" (UniqueName: \"kubernetes.io/projected/c38c339a-9d7a-4e28-b468-3cc25e37c751-kube-api-access-652c4\") pod \"openshift-lws-operator-fd8ccff4c-8mgkm\" (UID: \"c38c339a-9d7a-4e28-b468-3cc25e37c751\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:43:59.658426 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.658371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c38c339a-9d7a-4e28-b468-3cc25e37c751-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8mgkm\" (UID: \"c38c339a-9d7a-4e28-b468-3cc25e37c751\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:43:59.658731 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.658710 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c38c339a-9d7a-4e28-b468-3cc25e37c751-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8mgkm\" (UID: \"c38c339a-9d7a-4e28-b468-3cc25e37c751\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:43:59.665785 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.665762 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-652c4\" (UniqueName: \"kubernetes.io/projected/c38c339a-9d7a-4e28-b468-3cc25e37c751-kube-api-access-652c4\") pod \"openshift-lws-operator-fd8ccff4c-8mgkm\" (UID: \"c38c339a-9d7a-4e28-b468-3cc25e37c751\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:43:59.775059 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:43:59.774985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" Sep 09 17:44:00.045574 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:00.045489 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm"] Sep 09 17:44:00.048704 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:44:00.048677 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc38c339a_9d7a_4e28_b468_3cc25e37c751.slice/crio-b79e3bf0fc49189ee4cf37b299f282791139716f75474a112abb5e4bf92e8a63 WatchSource:0}: Error finding container b79e3bf0fc49189ee4cf37b299f282791139716f75474a112abb5e4bf92e8a63: Status 404 returned error can't find the container with id b79e3bf0fc49189ee4cf37b299f282791139716f75474a112abb5e4bf92e8a63 Sep 09 17:44:00.824350 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:00.824314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" event={"ID":"c38c339a-9d7a-4e28-b468-3cc25e37c751","Type":"ContainerStarted","Data":"b79e3bf0fc49189ee4cf37b299f282791139716f75474a112abb5e4bf92e8a63"} Sep 09 17:44:02.833168 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:02.833136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" event={"ID":"c38c339a-9d7a-4e28-b468-3cc25e37c751","Type":"ContainerStarted","Data":"89795aeeb7a47c9b1fdeb0eae9e6143e9cfaba66f5207a8c368e53897bdc02fa"} Sep 09 17:44:02.850923 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:02.850580 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8mgkm" podStartSLOduration=1.150986573 podStartE2EDuration="3.850560442s" totalImagesPullingTime="2.699573869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:44:02.84918263 +0000 UTC m=+223.498125447" watchObservedRunningTime="2026-09-09 17:44:02.850560442 +0000 UTC m=+223.499503259" Sep 09 17:44:22.703627 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.703594 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth"] Sep 09 17:44:22.706900 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.706879 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.709540 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.709519 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 17:44:22.709540 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.709527 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zvt44\"" Sep 09 17:44:22.709719 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.709562 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 17:44:22.709840 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.709826 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 17:44:22.709880 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.709859 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 17:44:22.717809 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.717790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-tmp\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.717906 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.717818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.717906 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.717888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqbpg\" (UniqueName: \"kubernetes.io/projected/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-kube-api-access-vqbpg\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.718014 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.717921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.718014 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.718000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-manifests\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.733672 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.733645 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth"] Sep 09 17:44:22.818855 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.818820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-tmp\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.818855 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.818857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.819100 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.818992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqbpg\" (UniqueName: \"kubernetes.io/projected/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-kube-api-access-vqbpg\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.819100 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.819033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.819100 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.819078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-manifests\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.819447 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.819426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-manifests\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.820941 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.820919 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-tmp\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.821177 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.821158 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.821236 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.821196 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:22.826390 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:22.826370 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqbpg\" (UniqueName: \"kubernetes.io/projected/6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3-kube-api-access-vqbpg\") pod \"opendatahub-operator-controller-manager-7d8b86c95-vdtth\" (UID: \"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3\") " pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:23.016798 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:23.016717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:23.293727 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:23.293662 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth"] Sep 09 17:44:23.296396 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:44:23.296369 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2a27ee_5e3e_44e0_b8e4_dc8830da85c3.slice/crio-13b10ea9f8c90b9dee98f76262b22677b58a2e6e94fd51e3d5975128e31781b9 WatchSource:0}: Error finding container 13b10ea9f8c90b9dee98f76262b22677b58a2e6e94fd51e3d5975128e31781b9: Status 404 returned error can't find the container with id 13b10ea9f8c90b9dee98f76262b22677b58a2e6e94fd51e3d5975128e31781b9 Sep 09 17:44:23.905004 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:23.904963 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" event={"ID":"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3","Type":"ContainerStarted","Data":"13b10ea9f8c90b9dee98f76262b22677b58a2e6e94fd51e3d5975128e31781b9"} Sep 09 17:44:26.920981 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:26.920927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" event={"ID":"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3","Type":"ContainerStarted","Data":"789d2cf6e4090ffc7385b5ba11f782ec85f4f94800fedcf9a5dd141496a3699c"} Sep 09 17:44:27.925626 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:27.925538 2561 generic.go:356] "Generic (PLEG): container finished" podID="6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3" containerID="789d2cf6e4090ffc7385b5ba11f782ec85f4f94800fedcf9a5dd141496a3699c" exitCode=0 Sep 09 17:44:27.926004 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:27.925620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" event={"ID":"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3","Type":"ContainerDied","Data":"789d2cf6e4090ffc7385b5ba11f782ec85f4f94800fedcf9a5dd141496a3699c"} Sep 09 17:44:28.931111 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:28.931079 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" event={"ID":"6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3","Type":"ContainerStarted","Data":"315ca8df7ffc27236ec210db7c1255dddbf7113f763c5912efd7bdb7cb2fe1c8"} Sep 09 17:44:28.931494 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:28.931190 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:28.954290 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:28.954245 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" podStartSLOduration=2.456639816 podStartE2EDuration="6.95423166s" totalImagesPullingTime="3.454671104s" totalInitContainerRuntime="1.04292074s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:44:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:44:28.952404851 +0000 UTC m=+249.601347668" watchObservedRunningTime="2026-09-09 17:44:28.95423166 +0000 UTC m=+249.603174476" Sep 09 17:44:39.937475 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:39.937438 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d8b86c95-vdtth" Sep 09 17:44:42.308554 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.308469 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7"] Sep 09 17:44:42.311604 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.311579 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.314221 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:42.314178 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" Sep 09 17:44:42.314221 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:42.314186 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-85fbc8bdbc-v57l7\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" podUID="354ebc3a-7b23-418d-846b-07177a66dbdc" pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.314409 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:42.314203 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 09 17:44:42.314409 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:42.314235 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 09 17:44:42.314409 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:42.314364 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-zkzzq\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zkzzq\"" type="*v1.Secret" Sep 09 17:44:42.314540 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:42.314459 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret" Sep 09 17:44:42.329329 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.329300 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7"] Sep 09 17:44:42.367369 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.367329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmg7d\" (UniqueName: \"kubernetes.io/projected/354ebc3a-7b23-418d-846b-07177a66dbdc-kube-api-access-qmg7d\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.367539 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.367376 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/354ebc3a-7b23-418d-846b-07177a66dbdc-tls-certs\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.367539 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.367407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/354ebc3a-7b23-418d-846b-07177a66dbdc-tmp\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.468659 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.468618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmg7d\" (UniqueName: \"kubernetes.io/projected/354ebc3a-7b23-418d-846b-07177a66dbdc-kube-api-access-qmg7d\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.468659 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.468662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/354ebc3a-7b23-418d-846b-07177a66dbdc-tls-certs\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.468840 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.468697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/354ebc3a-7b23-418d-846b-07177a66dbdc-tmp\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:42.470965 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:42.470942 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/354ebc3a-7b23-418d-846b-07177a66dbdc-tmp\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:43.142555 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.142524 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 17:44:43.329243 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.329201 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 17:44:43.333230 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.333204 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmg7d\" (UniqueName: \"kubernetes.io/projected/354ebc3a-7b23-418d-846b-07177a66dbdc-kube-api-access-qmg7d\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:43.344198 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.344177 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 17:44:43.469182 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:43.469148 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition Sep 09 17:44:43.469384 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:43.469249 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354ebc3a-7b23-418d-846b-07177a66dbdc-tls-certs podName:354ebc3a-7b23-418d-846b-07177a66dbdc nodeName:}" failed. No retries permitted until 2026-09-09 17:44:43.969229222 +0000 UTC m=+264.618172030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/354ebc3a-7b23-418d-846b-07177a66dbdc-tls-certs") pod "kube-auth-proxy-85fbc8bdbc-v57l7" (UID: "354ebc3a-7b23-418d-846b-07177a66dbdc") : failed to sync secret cache: timed out waiting for the condition Sep 09 17:44:43.486463 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.486431 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 17:44:43.599682 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.599649 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zkzzq\"" Sep 09 17:44:43.979042 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.979012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/354ebc3a-7b23-418d-846b-07177a66dbdc-tls-certs\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:43.981574 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:43.981548 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/354ebc3a-7b23-418d-846b-07177a66dbdc-tls-certs\") pod \"kube-auth-proxy-85fbc8bdbc-v57l7\" (UID: \"354ebc3a-7b23-418d-846b-07177a66dbdc\") " pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:44.120552 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:44.120490 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" Sep 09 17:44:44.390730 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:44.390647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7"] Sep 09 17:44:44.395370 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:44:44.395318 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354ebc3a_7b23_418d_846b_07177a66dbdc.slice/crio-4aa4631c53199c359fa65b526a40dabb5c4d46071d93c1d9353fca1bbbf43004 WatchSource:0}: Error finding container 4aa4631c53199c359fa65b526a40dabb5c4d46071d93c1d9353fca1bbbf43004: Status 404 returned error can't find the container with id 4aa4631c53199c359fa65b526a40dabb5c4d46071d93c1d9353fca1bbbf43004 Sep 09 17:44:44.986990 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:44.986939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" event={"ID":"354ebc3a-7b23-418d-846b-07177a66dbdc","Type":"ContainerStarted","Data":"4aa4631c53199c359fa65b526a40dabb5c4d46071d93c1d9353fca1bbbf43004"} Sep 09 17:44:48.002605 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.002570 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" event={"ID":"354ebc3a-7b23-418d-846b-07177a66dbdc","Type":"ContainerStarted","Data":"216af29dd38dbe579ad490bf0015fb522160d8716f101e4b581249fb608535eb"} Sep 09 17:44:48.017946 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.017896 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85fbc8bdbc-v57l7" podStartSLOduration=3.3176358759999998 podStartE2EDuration="6.017880737s" totalImagesPullingTime="2.700244861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:44:48.016270162 +0000 UTC m=+268.665212978" watchObservedRunningTime="2026-09-09 17:44:48.017880737 +0000 UTC m=+268.666823553" Sep 09 17:44:48.857788 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.857756 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r"] Sep 09 17:44:48.861053 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.861033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.863044 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.863023 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 17:44:48.863134 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.863081 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zj99m\"" Sep 09 17:44:48.871997 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.871971 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r"] Sep 09 17:44:48.923848 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.923812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.923848 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.923852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.924095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.923891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.924095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.923930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.924095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.923951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.924095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.924033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.924095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.924072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpblj\" (UniqueName: \"kubernetes.io/projected/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-kube-api-access-gpblj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.924095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.924092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:48.924300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:48.924116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.025524 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpblj\" (UniqueName: \"kubernetes.io/projected/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-kube-api-access-gpblj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.025729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026473 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.026151 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026473 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.026183 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026473 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.026230 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026473 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.026406 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.026840 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.026819 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.027911 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.027889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.028249 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.028231 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.040766 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.040742 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.043845 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.043823 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpblj\" (UniqueName: \"kubernetes.io/projected/e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308-kube-api-access-gpblj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r\" (UID: \"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.170670 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.170581 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:49.443582 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:49.443548 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r"] Sep 09 17:44:49.447096 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:44:49.447071 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f0f1eb_5a72_4f04_92c9_04e9d0b9a308.slice/crio-8e2c20edfa570384b6c673cc2e8fb827d69c3678a583a1c0114321e85308690b WatchSource:0}: Error finding container 8e2c20edfa570384b6c673cc2e8fb827d69c3678a583a1c0114321e85308690b: Status 404 returned error can't find the container with id 8e2c20edfa570384b6c673cc2e8fb827d69c3678a583a1c0114321e85308690b Sep 09 17:44:50.010814 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:50.010779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" event={"ID":"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308","Type":"ContainerStarted","Data":"8e2c20edfa570384b6c673cc2e8fb827d69c3678a583a1c0114321e85308690b"} Sep 09 17:44:52.769808 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:52.769768 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 09 17:44:52.770105 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:52.769842 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 09 17:44:52.770105 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:52.769873 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 09 17:44:53.026719 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.026633 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" event={"ID":"e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308","Type":"ContainerStarted","Data":"20199a3b113d328ef37377b44f8e3952d5794e3033d9bb53aa4333b0b3ad45ed"} Sep 09 17:44:53.049709 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.049652 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" podStartSLOduration=1.729086985 podStartE2EDuration="5.049633489s" totalImagesPullingTime="3.320546504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:44:53.048200485 +0000 UTC m=+273.697143300" watchObservedRunningTime="2026-09-09 17:44:53.049633489 +0000 UTC m=+273.698576307" Sep 09 17:44:53.171393 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.171357 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:53.172750 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.172726 2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Sep 09 17:44:53.172857 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.172770 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" podUID="e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Sep 09 17:44:53.232063 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.232030 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-84gmc"] Sep 09 17:44:53.235150 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.235133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.237153 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.237131 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6z4t7\"" Sep 09 17:44:53.237305 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.237283 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 09 17:44:53.258008 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.257973 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-84gmc"] Sep 09 17:44:53.363473 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.363372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b086bf3f-39a1-4c18-9ad2-b0071e78365b-cert\") pod \"odh-model-controller-7998c67dc4-84gmc\" (UID: \"b086bf3f-39a1-4c18-9ad2-b0071e78365b\") " pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.363473 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.363434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6899f\" (UniqueName: \"kubernetes.io/projected/b086bf3f-39a1-4c18-9ad2-b0071e78365b-kube-api-access-6899f\") pod \"odh-model-controller-7998c67dc4-84gmc\" (UID: \"b086bf3f-39a1-4c18-9ad2-b0071e78365b\") " pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.464649 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.464616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b086bf3f-39a1-4c18-9ad2-b0071e78365b-cert\") pod \"odh-model-controller-7998c67dc4-84gmc\" (UID: \"b086bf3f-39a1-4c18-9ad2-b0071e78365b\") " pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.464649 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.464650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6899f\" (UniqueName: \"kubernetes.io/projected/b086bf3f-39a1-4c18-9ad2-b0071e78365b-kube-api-access-6899f\") pod \"odh-model-controller-7998c67dc4-84gmc\" (UID: \"b086bf3f-39a1-4c18-9ad2-b0071e78365b\") " pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.464844 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:53.464770 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 09 17:44:53.464844 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:53.464840 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b086bf3f-39a1-4c18-9ad2-b0071e78365b-cert podName:b086bf3f-39a1-4c18-9ad2-b0071e78365b nodeName:}" failed. No retries permitted until 2026-09-09 17:44:53.964819059 +0000 UTC m=+274.613761871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b086bf3f-39a1-4c18-9ad2-b0071e78365b-cert") pod "odh-model-controller-7998c67dc4-84gmc" (UID: "b086bf3f-39a1-4c18-9ad2-b0071e78365b") : secret "odh-model-controller-webhook-cert" not found Sep 09 17:44:53.474646 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.474626 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6899f\" (UniqueName: \"kubernetes.io/projected/b086bf3f-39a1-4c18-9ad2-b0071e78365b-kube-api-access-6899f\") pod \"odh-model-controller-7998c67dc4-84gmc\" (UID: \"b086bf3f-39a1-4c18-9ad2-b0071e78365b\") " pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.770878 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.770847 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-62rm5"] Sep 09 17:44:53.774143 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.774127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:53.776081 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.776063 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 09 17:44:53.784788 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.784766 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-62rm5"] Sep 09 17:44:53.869029 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.868995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28863f5b-9a41-47cc-89f8-a17c7bd9f576-tls-certs\") pod \"model-serving-api-54d89bd5fc-62rm5\" (UID: \"28863f5b-9a41-47cc-89f8-a17c7bd9f576\") " pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:53.869188 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.869055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r6m6\" (UniqueName: \"kubernetes.io/projected/28863f5b-9a41-47cc-89f8-a17c7bd9f576-kube-api-access-8r6m6\") pod \"model-serving-api-54d89bd5fc-62rm5\" (UID: \"28863f5b-9a41-47cc-89f8-a17c7bd9f576\") " pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:53.970076 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.970041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b086bf3f-39a1-4c18-9ad2-b0071e78365b-cert\") pod \"odh-model-controller-7998c67dc4-84gmc\" (UID: \"b086bf3f-39a1-4c18-9ad2-b0071e78365b\") " pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.970215 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.970094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28863f5b-9a41-47cc-89f8-a17c7bd9f576-tls-certs\") pod \"model-serving-api-54d89bd5fc-62rm5\" (UID: \"28863f5b-9a41-47cc-89f8-a17c7bd9f576\") " pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:53.970215 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.970131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r6m6\" (UniqueName: \"kubernetes.io/projected/28863f5b-9a41-47cc-89f8-a17c7bd9f576-kube-api-access-8r6m6\") pod \"model-serving-api-54d89bd5fc-62rm5\" (UID: \"28863f5b-9a41-47cc-89f8-a17c7bd9f576\") " pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:53.970296 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:53.970241 2561 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 09 17:44:53.970334 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:44:53.970304 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28863f5b-9a41-47cc-89f8-a17c7bd9f576-tls-certs podName:28863f5b-9a41-47cc-89f8-a17c7bd9f576 nodeName:}" failed. No retries permitted until 2026-09-09 17:44:54.4702878 +0000 UTC m=+275.119230594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/28863f5b-9a41-47cc-89f8-a17c7bd9f576-tls-certs") pod "model-serving-api-54d89bd5fc-62rm5" (UID: "28863f5b-9a41-47cc-89f8-a17c7bd9f576") : secret "model-serving-api-tls" not found Sep 09 17:44:53.972423 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.972402 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b086bf3f-39a1-4c18-9ad2-b0071e78365b-cert\") pod \"odh-model-controller-7998c67dc4-84gmc\" (UID: \"b086bf3f-39a1-4c18-9ad2-b0071e78365b\") " pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:53.977899 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:53.977879 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r6m6\" (UniqueName: \"kubernetes.io/projected/28863f5b-9a41-47cc-89f8-a17c7bd9f576-kube-api-access-8r6m6\") pod \"model-serving-api-54d89bd5fc-62rm5\" (UID: \"28863f5b-9a41-47cc-89f8-a17c7bd9f576\") " pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:54.145715 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:54.145634 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:54.175562 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:54.175533 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:54.424012 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:54.423911 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-84gmc"] Sep 09 17:44:54.428315 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:44:54.428284 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb086bf3f_39a1_4c18_9ad2_b0071e78365b.slice/crio-4a91dfc512a85cd7b76fa9b049a3a8e09985faa133af6023da16a4ae78d79aae WatchSource:0}: Error finding container 4a91dfc512a85cd7b76fa9b049a3a8e09985faa133af6023da16a4ae78d79aae: Status 404 returned error can't find the container with id 4a91dfc512a85cd7b76fa9b049a3a8e09985faa133af6023da16a4ae78d79aae Sep 09 17:44:54.475229 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:54.475193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28863f5b-9a41-47cc-89f8-a17c7bd9f576-tls-certs\") pod \"model-serving-api-54d89bd5fc-62rm5\" (UID: \"28863f5b-9a41-47cc-89f8-a17c7bd9f576\") " pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:54.477560 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:54.477539 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28863f5b-9a41-47cc-89f8-a17c7bd9f576-tls-certs\") pod \"model-serving-api-54d89bd5fc-62rm5\" (UID: \"28863f5b-9a41-47cc-89f8-a17c7bd9f576\") " pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:54.684992 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:54.684951 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:54.954434 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:54.954359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-62rm5"] Sep 09 17:44:54.958257 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:44:54.958231 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28863f5b_9a41_47cc_89f8_a17c7bd9f576.slice/crio-6ab89f098e116cdc2146d2dc98ef4533d9fa929f9a9e8167900c558ae7a47ff6 WatchSource:0}: Error finding container 6ab89f098e116cdc2146d2dc98ef4533d9fa929f9a9e8167900c558ae7a47ff6: Status 404 returned error can't find the container with id 6ab89f098e116cdc2146d2dc98ef4533d9fa929f9a9e8167900c558ae7a47ff6 Sep 09 17:44:55.036281 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:55.036245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" event={"ID":"28863f5b-9a41-47cc-89f8-a17c7bd9f576","Type":"ContainerStarted","Data":"6ab89f098e116cdc2146d2dc98ef4533d9fa929f9a9e8167900c558ae7a47ff6"} Sep 09 17:44:55.037306 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:55.037278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" event={"ID":"b086bf3f-39a1-4c18-9ad2-b0071e78365b","Type":"ContainerStarted","Data":"4a91dfc512a85cd7b76fa9b049a3a8e09985faa133af6023da16a4ae78d79aae"} Sep 09 17:44:55.037607 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:55.037590 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:55.038640 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:55.038626 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r" Sep 09 17:44:59.062051 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.062008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" event={"ID":"28863f5b-9a41-47cc-89f8-a17c7bd9f576","Type":"ContainerStarted","Data":"935d774b258eb2a8b8035e915c0e9653ef2cf53f350c10325037a8f5c64a6594"} Sep 09 17:44:59.062536 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.062079 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:44:59.063498 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.063462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" event={"ID":"b086bf3f-39a1-4c18-9ad2-b0071e78365b","Type":"ContainerStarted","Data":"22199ff105398cadbbd380d67f77cf78c5db51de31e2c6214a3161c415f2142a"} Sep 09 17:44:59.063610 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.063508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:44:59.079891 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.079842 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" podStartSLOduration=3.046686391 podStartE2EDuration="6.079827529s" totalImagesPullingTime="3.033141138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:44:59.078611514 +0000 UTC m=+279.727554355" watchObservedRunningTime="2026-09-09 17:44:59.079827529 +0000 UTC m=+279.728770345" Sep 09 17:44:59.094793 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.094748 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" podStartSLOduration=2.534477794 podStartE2EDuration="6.09473276s" totalImagesPullingTime="3.560254966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:44:59.093540514 +0000 UTC m=+279.742483330" watchObservedRunningTime="2026-09-09 17:44:59.09473276 +0000 UTC m=+279.743675575" Sep 09 17:44:59.594994 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.594950 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2"] Sep 09 17:44:59.597392 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.597372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.599462 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.599427 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 17:44:59.599462 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.599440 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h7wfp\"" Sep 09 17:44:59.599462 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.599434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 17:44:59.599655 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.599476 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 17:44:59.610475 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.610455 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2"] Sep 09 17:44:59.724187 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.724156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.724351 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.724200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.724351 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.724219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967rc\" (UniqueName: \"kubernetes.io/projected/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-kube-api-access-967rc\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.724351 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.724291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.724351 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.724327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.724351 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.724348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.724569 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.724423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.825804 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.825774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.825948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.825818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.825948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.825851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.825948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.825875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967rc\" (UniqueName: \"kubernetes.io/projected/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-kube-api-access-967rc\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.825948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.825910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.825948 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.825943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.826218 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.826024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.826629 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.826604 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.828300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.828277 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.828300 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.828284 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.828437 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.828334 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.828437 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.828410 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.838066 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.838043 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.842273 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.842252 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967rc\" (UniqueName: \"kubernetes.io/projected/5d79de73-4683-49dd-9ba7-c35e4d4cb57c-kube-api-access-967rc\") pod \"istiod-openshift-gateway-5677ccb49b-fwvl2\" (UID: \"5d79de73-4683-49dd-9ba7-c35e4d4cb57c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:44:59.906144 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:44:59.906078 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:45:00.212200 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:00.212169 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2"] Sep 09 17:45:00.215186 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:45:00.215162 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d79de73_4683_49dd_9ba7_c35e4d4cb57c.slice/crio-ffde96af02b104b8ff2220318e845b31b96c08e0f335801a0c0987f91b5fbb38 WatchSource:0}: Error finding container ffde96af02b104b8ff2220318e845b31b96c08e0f335801a0c0987f91b5fbb38: Status 404 returned error can't find the container with id ffde96af02b104b8ff2220318e845b31b96c08e0f335801a0c0987f91b5fbb38 Sep 09 17:45:01.075573 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:01.075530 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" event={"ID":"5d79de73-4683-49dd-9ba7-c35e4d4cb57c","Type":"ContainerStarted","Data":"ffde96af02b104b8ff2220318e845b31b96c08e0f335801a0c0987f91b5fbb38"} Sep 09 17:45:02.678816 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.678776 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 09 17:45:02.679128 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.678855 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 09 17:45:02.851729 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.851694 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w"] Sep 09 17:45:02.854087 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.854067 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:02.856982 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.856946 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-g4tb7\"" Sep 09 17:45:02.857719 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.857703 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 09 17:45:02.871046 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.870967 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w"] Sep 09 17:45:02.880094 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.880065 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr"] Sep 09 17:45:02.882611 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.882591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:02.885432 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.885409 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4xqmz\"" Sep 09 17:45:02.885432 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.885431 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 09 17:45:02.897518 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.897494 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr"] Sep 09 17:45:02.956758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.956727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2t9h\" (UniqueName: \"kubernetes.io/projected/a55333b8-1a0d-4a86-b098-9c667fda796c-kube-api-access-m2t9h\") pod \"llmisvc-controller-manager-777c6bd7d5-6wgmr\" (UID: \"a55333b8-1a0d-4a86-b098-9c667fda796c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:02.956758 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.956760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ks8\" (UniqueName: \"kubernetes.io/projected/7e538a1e-f5ab-4f85-827a-5acd8abf2c60-kube-api-access-j9ks8\") pod \"kserve-controller-manager-d6f4b65b8-j4l9w\" (UID: \"7e538a1e-f5ab-4f85-827a-5acd8abf2c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:02.957022 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.956903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e538a1e-f5ab-4f85-827a-5acd8abf2c60-cert\") pod \"kserve-controller-manager-d6f4b65b8-j4l9w\" (UID: \"7e538a1e-f5ab-4f85-827a-5acd8abf2c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:02.957022 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:02.956949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a55333b8-1a0d-4a86-b098-9c667fda796c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6wgmr\" (UID: \"a55333b8-1a0d-4a86-b098-9c667fda796c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:03.058008 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.057969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a55333b8-1a0d-4a86-b098-9c667fda796c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6wgmr\" (UID: \"a55333b8-1a0d-4a86-b098-9c667fda796c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:03.058008 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.058012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2t9h\" (UniqueName: \"kubernetes.io/projected/a55333b8-1a0d-4a86-b098-9c667fda796c-kube-api-access-m2t9h\") pod \"llmisvc-controller-manager-777c6bd7d5-6wgmr\" (UID: \"a55333b8-1a0d-4a86-b098-9c667fda796c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:03.058265 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.058029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ks8\" (UniqueName: \"kubernetes.io/projected/7e538a1e-f5ab-4f85-827a-5acd8abf2c60-kube-api-access-j9ks8\") pod \"kserve-controller-manager-d6f4b65b8-j4l9w\" (UID: \"7e538a1e-f5ab-4f85-827a-5acd8abf2c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:03.058265 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.058089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e538a1e-f5ab-4f85-827a-5acd8abf2c60-cert\") pod \"kserve-controller-manager-d6f4b65b8-j4l9w\" (UID: \"7e538a1e-f5ab-4f85-827a-5acd8abf2c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:03.060561 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.060538 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e538a1e-f5ab-4f85-827a-5acd8abf2c60-cert\") pod \"kserve-controller-manager-d6f4b65b8-j4l9w\" (UID: \"7e538a1e-f5ab-4f85-827a-5acd8abf2c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:03.060664 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.060602 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a55333b8-1a0d-4a86-b098-9c667fda796c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6wgmr\" (UID: \"a55333b8-1a0d-4a86-b098-9c667fda796c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:03.067438 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.067417 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2t9h\" (UniqueName: \"kubernetes.io/projected/a55333b8-1a0d-4a86-b098-9c667fda796c-kube-api-access-m2t9h\") pod \"llmisvc-controller-manager-777c6bd7d5-6wgmr\" (UID: \"a55333b8-1a0d-4a86-b098-9c667fda796c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:03.067684 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.067664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ks8\" (UniqueName: \"kubernetes.io/projected/7e538a1e-f5ab-4f85-827a-5acd8abf2c60-kube-api-access-j9ks8\") pod \"kserve-controller-manager-d6f4b65b8-j4l9w\" (UID: \"7e538a1e-f5ab-4f85-827a-5acd8abf2c60\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:03.086868 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.086836 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" event={"ID":"5d79de73-4683-49dd-9ba7-c35e4d4cb57c","Type":"ContainerStarted","Data":"ee49e032caed20b1c818de3fd4448db8a51459148e0bf4139bd61089399e7693"} Sep 09 17:45:03.086995 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.086892 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:45:03.088697 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.088676 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fwvl2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 09 17:45:03.088781 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.088721 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" podUID="5d79de73-4683-49dd-9ba7-c35e4d4cb57c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 17:45:03.108646 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.108592 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" podStartSLOduration=1.647307664 podStartE2EDuration="4.108578036s" totalImagesPullingTime="2.461270372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:45:03.107868225 +0000 UTC m=+283.756811041" watchObservedRunningTime="2026-09-09 17:45:03.108578036 +0000 UTC m=+283.757520852" Sep 09 17:45:03.164322 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.164295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:03.193691 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.193662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:03.439763 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.439731 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w"] Sep 09 17:45:03.443354 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:45:03.443305 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e538a1e_f5ab_4f85_827a_5acd8abf2c60.slice/crio-63f8919ed4fe651e3f435a4f928e34f72eb70026f22fb22e4dcfeb5f1444d8ab WatchSource:0}: Error finding container 63f8919ed4fe651e3f435a4f928e34f72eb70026f22fb22e4dcfeb5f1444d8ab: Status 404 returned error can't find the container with id 63f8919ed4fe651e3f435a4f928e34f72eb70026f22fb22e4dcfeb5f1444d8ab Sep 09 17:45:03.469592 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:03.469546 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr"] Sep 09 17:45:03.473274 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:45:03.473254 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda55333b8_1a0d_4a86_b098_9c667fda796c.slice/crio-c420af7df92e056eef6ac59185061f472bc22605bacd34dd2b0738478521aef8 WatchSource:0}: Error finding container c420af7df92e056eef6ac59185061f472bc22605bacd34dd2b0738478521aef8: Status 404 returned error can't find the container with id c420af7df92e056eef6ac59185061f472bc22605bacd34dd2b0738478521aef8 Sep 09 17:45:04.092428 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:04.092393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" event={"ID":"a55333b8-1a0d-4a86-b098-9c667fda796c","Type":"ContainerStarted","Data":"c420af7df92e056eef6ac59185061f472bc22605bacd34dd2b0738478521aef8"} Sep 09 17:45:04.093667 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:04.093641 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" event={"ID":"7e538a1e-f5ab-4f85-827a-5acd8abf2c60","Type":"ContainerStarted","Data":"63f8919ed4fe651e3f435a4f928e34f72eb70026f22fb22e4dcfeb5f1444d8ab"} Sep 09 17:45:04.094378 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:04.094356 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fwvl2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 09 17:45:04.094452 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:04.094402 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" podUID="5d79de73-4683-49dd-9ba7-c35e4d4cb57c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 17:45:07.094879 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:07.094843 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fwvl2" Sep 09 17:45:07.107870 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:07.107838 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" event={"ID":"7e538a1e-f5ab-4f85-827a-5acd8abf2c60","Type":"ContainerStarted","Data":"e7f96ff7450115a9eae224d932d737ca4692cbf2090ec7d4e6c2a8de0334fbf8"} Sep 09 17:45:07.108063 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:07.107911 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:07.131234 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:07.131166 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" podStartSLOduration=2.435909449 podStartE2EDuration="5.13114456s" totalImagesPullingTime="2.695235111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:45:07.129191329 +0000 UTC m=+287.778134174" watchObservedRunningTime="2026-09-09 17:45:07.13114456 +0000 UTC m=+287.780087377" Sep 09 17:45:08.113326 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:08.113286 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" event={"ID":"a55333b8-1a0d-4a86-b098-9c667fda796c","Type":"ContainerStarted","Data":"6f1fcc1ae7e9f4e8d46d2628cbdad77dec8d72265c66a95cc30d330192b636d2"} Sep 09 17:45:08.113730 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:08.113367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:45:08.147193 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:08.147144 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" podStartSLOduration=2.270084361 podStartE2EDuration="6.147126451s" totalImagesPullingTime="3.87704209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:45:08.146247137 +0000 UTC m=+288.795189953" watchObservedRunningTime="2026-09-09 17:45:08.147126451 +0000 UTC m=+288.796069267" Sep 09 17:45:10.075360 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:10.075325 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-84gmc" Sep 09 17:45:10.076844 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:10.076822 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-62rm5" Sep 09 17:45:19.709528 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:19.709495 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:45:19.710008 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:19.709720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:45:19.713094 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:19.713075 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 17:45:38.118607 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:38.118574 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j4l9w" Sep 09 17:45:39.120678 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:45:39.120647 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6wgmr" Sep 09 17:46:13.616755 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.616675 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54445f59c6-dpwrr"] Sep 09 17:46:13.619801 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.619781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.621946 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.621922 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 17:46:13.622063 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.622042 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 17:46:13.622723 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.622687 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 17:46:13.622828 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.622777 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 17:46:13.622893 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.622814 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zr8xv\"" Sep 09 17:46:13.623217 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.623130 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 17:46:13.623434 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.623412 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 17:46:13.625193 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.625168 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 17:46:13.627186 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.627168 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 17:46:13.631502 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.631479 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54445f59c6-dpwrr"] Sep 09 17:46:13.642818 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.642789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-console-config\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.642998 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.642827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htg8g\" (UniqueName: \"kubernetes.io/projected/a476733a-f243-4dda-82c6-c797d4125f78-kube-api-access-htg8g\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.642998 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.642875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-trusted-ca-bundle\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.642998 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.642906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a476733a-f243-4dda-82c6-c797d4125f78-console-serving-cert\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.642998 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.642928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a476733a-f243-4dda-82c6-c797d4125f78-console-oauth-config\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.643165 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.643023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-oauth-serving-cert\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.643165 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.643092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-service-ca\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.744257 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.744221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-console-config\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.744257 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.744258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htg8g\" (UniqueName: \"kubernetes.io/projected/a476733a-f243-4dda-82c6-c797d4125f78-kube-api-access-htg8g\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.744524 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.744292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-trusted-ca-bundle\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.744524 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.744312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a476733a-f243-4dda-82c6-c797d4125f78-console-serving-cert\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.744524 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.744330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a476733a-f243-4dda-82c6-c797d4125f78-console-oauth-config\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.744524 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.744361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-oauth-serving-cert\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.744524 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.744411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-service-ca\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.745128 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.745105 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-service-ca\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.745224 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.745105 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-console-config\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.745224 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.745176 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-oauth-serving-cert\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.745309 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.745240 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a476733a-f243-4dda-82c6-c797d4125f78-trusted-ca-bundle\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.746737 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.746711 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a476733a-f243-4dda-82c6-c797d4125f78-console-oauth-config\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.746978 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.746937 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a476733a-f243-4dda-82c6-c797d4125f78-console-serving-cert\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.754734 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.754710 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htg8g\" (UniqueName: \"kubernetes.io/projected/a476733a-f243-4dda-82c6-c797d4125f78-kube-api-access-htg8g\") pod \"console-54445f59c6-dpwrr\" (UID: \"a476733a-f243-4dda-82c6-c797d4125f78\") " pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:13.930209 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:13.930121 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:14.204998 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.204928 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54445f59c6-dpwrr"] Sep 09 17:46:14.207699 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:46:14.207670 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda476733a_f243_4dda_82c6_c797d4125f78.slice/crio-36d25378cc8636d451477b8ce3e2a2d7bf8b19ed76ac5ecc7aa2eae9eebbd987 WatchSource:0}: Error finding container 36d25378cc8636d451477b8ce3e2a2d7bf8b19ed76ac5ecc7aa2eae9eebbd987: Status 404 returned error can't find the container with id 36d25378cc8636d451477b8ce3e2a2d7bf8b19ed76ac5ecc7aa2eae9eebbd987 Sep 09 17:46:14.337945 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.337907 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb"] Sep 09 17:46:14.341602 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.341574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" Sep 09 17:46:14.343905 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.343880 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 17:46:14.344059 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.343886 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pqj99\"" Sep 09 17:46:14.344361 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.344331 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 09 17:46:14.344655 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.344336 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 17:46:14.362038 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.362007 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb"] Sep 09 17:46:14.398883 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.398837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54445f59c6-dpwrr" event={"ID":"a476733a-f243-4dda-82c6-c797d4125f78","Type":"ContainerStarted","Data":"027f5ac855172c6af17127243760b4f056890c3eba4e9e51a48c18bb414e52a1"} Sep 09 17:46:14.399089 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.398905 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54445f59c6-dpwrr" event={"ID":"a476733a-f243-4dda-82c6-c797d4125f78","Type":"ContainerStarted","Data":"36d25378cc8636d451477b8ce3e2a2d7bf8b19ed76ac5ecc7aa2eae9eebbd987"} Sep 09 17:46:14.426006 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.425621 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54445f59c6-dpwrr" podStartSLOduration=1.42559641 podStartE2EDuration="1.42559641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:46:14.424309616 +0000 UTC m=+355.073252433" watchObservedRunningTime="2026-09-09 17:46:14.42559641 +0000 UTC m=+355.074539227" Sep 09 17:46:14.450982 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.450913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jd6\" (UniqueName: \"kubernetes.io/projected/68190801-80e4-4b8f-99c1-4771fc80b23d-kube-api-access-88jd6\") pod \"dns-operator-controller-manager-7b84cd7c9c-94bkb\" (UID: \"68190801-80e4-4b8f-99c1-4771fc80b23d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" Sep 09 17:46:14.552659 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.552569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jd6\" (UniqueName: \"kubernetes.io/projected/68190801-80e4-4b8f-99c1-4771fc80b23d-kube-api-access-88jd6\") pod \"dns-operator-controller-manager-7b84cd7c9c-94bkb\" (UID: \"68190801-80e4-4b8f-99c1-4771fc80b23d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" Sep 09 17:46:14.560487 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.560461 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jd6\" (UniqueName: \"kubernetes.io/projected/68190801-80e4-4b8f-99c1-4771fc80b23d-kube-api-access-88jd6\") pod \"dns-operator-controller-manager-7b84cd7c9c-94bkb\" (UID: \"68190801-80e4-4b8f-99c1-4771fc80b23d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" Sep 09 17:46:14.654462 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.654416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" Sep 09 17:46:14.926909 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.926699 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb"] Sep 09 17:46:14.929543 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:46:14.929518 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68190801_80e4_4b8f_99c1_4771fc80b23d.slice/crio-1749649ffe49b9d55a7c782412d1fcbafb9c4539139672d0a2e0577a73bd1d12 WatchSource:0}: Error finding container 1749649ffe49b9d55a7c782412d1fcbafb9c4539139672d0a2e0577a73bd1d12: Status 404 returned error can't find the container with id 1749649ffe49b9d55a7c782412d1fcbafb9c4539139672d0a2e0577a73bd1d12 Sep 09 17:46:14.931867 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:14.931849 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 17:46:15.404615 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:15.404575 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" event={"ID":"68190801-80e4-4b8f-99c1-4771fc80b23d","Type":"ContainerStarted","Data":"1749649ffe49b9d55a7c782412d1fcbafb9c4539139672d0a2e0577a73bd1d12"} Sep 09 17:46:16.813096 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:16.813053 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6"] Sep 09 17:46:16.817078 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:16.817047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:16.819678 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:16.819653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vf4vr\"" Sep 09 17:46:16.833251 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:16.833200 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6"] Sep 09 17:46:16.876095 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:16.875701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp7s2\" (UniqueName: \"kubernetes.io/projected/1b8c1aef-b0bf-45a3-b1b9-e5c3013608be-kube-api-access-bp7s2\") pod \"limitador-operator-controller-manager-74495c69f8-zc8r6\" (UID: \"1b8c1aef-b0bf-45a3-b1b9-e5c3013608be\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:16.976692 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:16.976650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp7s2\" (UniqueName: \"kubernetes.io/projected/1b8c1aef-b0bf-45a3-b1b9-e5c3013608be-kube-api-access-bp7s2\") pod \"limitador-operator-controller-manager-74495c69f8-zc8r6\" (UID: \"1b8c1aef-b0bf-45a3-b1b9-e5c3013608be\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:16.991018 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:16.990910 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp7s2\" (UniqueName: \"kubernetes.io/projected/1b8c1aef-b0bf-45a3-b1b9-e5c3013608be-kube-api-access-bp7s2\") pod \"limitador-operator-controller-manager-74495c69f8-zc8r6\" (UID: \"1b8c1aef-b0bf-45a3-b1b9-e5c3013608be\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:17.130292 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:17.130194 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:17.426420 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:17.426348 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6"] Sep 09 17:46:17.430270 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:46:17.430232 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8c1aef_b0bf_45a3_b1b9_e5c3013608be.slice/crio-f7e3e292ab5a2dcfba38c7a629d99df1c8c5badeffa71fd0c59d2f1e27ea282b WatchSource:0}: Error finding container f7e3e292ab5a2dcfba38c7a629d99df1c8c5badeffa71fd0c59d2f1e27ea282b: Status 404 returned error can't find the container with id f7e3e292ab5a2dcfba38c7a629d99df1c8c5badeffa71fd0c59d2f1e27ea282b Sep 09 17:46:18.422032 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:18.421978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" event={"ID":"1b8c1aef-b0bf-45a3-b1b9-e5c3013608be","Type":"ContainerStarted","Data":"f7e3e292ab5a2dcfba38c7a629d99df1c8c5badeffa71fd0c59d2f1e27ea282b"} Sep 09 17:46:19.428937 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:19.428896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" event={"ID":"68190801-80e4-4b8f-99c1-4771fc80b23d","Type":"ContainerStarted","Data":"5d5b8005c4ef4dd7a485ecf52567b116afdf2ac28a27d9cc714a8dc4352145c1"} Sep 09 17:46:19.429482 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:19.429026 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" Sep 09 17:46:19.450610 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:19.450566 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" podStartSLOduration=1.683488306 podStartE2EDuration="5.450549784s" totalImagesPullingTime="3.767061478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:46:19.44809762 +0000 UTC m=+360.097040436" watchObservedRunningTime="2026-09-09 17:46:19.450549784 +0000 UTC m=+360.099492591" Sep 09 17:46:20.436696 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:20.436657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" event={"ID":"1b8c1aef-b0bf-45a3-b1b9-e5c3013608be","Type":"ContainerStarted","Data":"2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710"} Sep 09 17:46:20.453422 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:20.453359 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" podStartSLOduration=2.440141995 podStartE2EDuration="4.453337506s" totalImagesPullingTime="2.013195511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:46:20.452806203 +0000 UTC m=+361.101749020" watchObservedRunningTime="2026-09-09 17:46:20.453337506 +0000 UTC m=+361.102280323" Sep 09 17:46:21.441381 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:21.441346 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:23.931230 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:23.931184 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:23.931626 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:23.931263 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:23.936239 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:23.936217 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:24.459225 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:24.459198 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54445f59c6-dpwrr" Sep 09 17:46:30.439462 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.439430 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-94bkb" Sep 09 17:46:30.944732 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.944700 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh"] Sep 09 17:46:30.948150 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.948134 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:30.953187 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.953167 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-httg2\"" Sep 09 17:46:30.976872 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.976843 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh"] Sep 09 17:46:30.982135 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.982105 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6"] Sep 09 17:46:30.982305 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.982281 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" containerName="manager" containerID="cri-o://2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710" gracePeriod=2 Sep 09 17:46:30.984205 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.984188 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:30.997867 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:30.997842 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6"] Sep 09 17:46:31.004047 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.004012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b760056b-1ec3-4ad1-9f39-2c7f98380d56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kzwvh\" (UID: \"b760056b-1ec3-4ad1-9f39-2c7f98380d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:31.004185 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.004119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv6t5\" (UniqueName: \"kubernetes.io/projected/b760056b-1ec3-4ad1-9f39-2c7f98380d56-kube-api-access-vv6t5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kzwvh\" (UID: \"b760056b-1ec3-4ad1-9f39-2c7f98380d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:31.009007 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:46:31.008946 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zc8r6\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:31.026984 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.026945 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq"] Sep 09 17:46:31.027473 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.027457 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" containerName="manager" Sep 09 17:46:31.027532 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.027476 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" containerName="manager" Sep 09 17:46:31.027587 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.027577 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" containerName="manager" Sep 09 17:46:31.030844 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.030827 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" Sep 09 17:46:31.055635 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.055606 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq"] Sep 09 17:46:31.072022 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:46:31.071981 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zc8r6\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:31.104998 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.104943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv6t5\" (UniqueName: \"kubernetes.io/projected/b760056b-1ec3-4ad1-9f39-2c7f98380d56-kube-api-access-vv6t5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kzwvh\" (UID: \"b760056b-1ec3-4ad1-9f39-2c7f98380d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:31.105111 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.105070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b760056b-1ec3-4ad1-9f39-2c7f98380d56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kzwvh\" (UID: \"b760056b-1ec3-4ad1-9f39-2c7f98380d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:31.105156 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.105115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdpc7\" (UniqueName: \"kubernetes.io/projected/1c9bfe70-595e-4849-9381-d71c4fd4bf9b-kube-api-access-kdpc7\") pod \"limitador-operator-controller-manager-74495c69f8-mvbtq\" (UID: \"1c9bfe70-595e-4849-9381-d71c4fd4bf9b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" Sep 09 17:46:31.105388 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.105370 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b760056b-1ec3-4ad1-9f39-2c7f98380d56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kzwvh\" (UID: \"b760056b-1ec3-4ad1-9f39-2c7f98380d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:31.120790 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.120756 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv6t5\" (UniqueName: \"kubernetes.io/projected/b760056b-1ec3-4ad1-9f39-2c7f98380d56-kube-api-access-vv6t5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kzwvh\" (UID: \"b760056b-1ec3-4ad1-9f39-2c7f98380d56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:31.206558 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.206530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdpc7\" (UniqueName: \"kubernetes.io/projected/1c9bfe70-595e-4849-9381-d71c4fd4bf9b-kube-api-access-kdpc7\") pod \"limitador-operator-controller-manager-74495c69f8-mvbtq\" (UID: \"1c9bfe70-595e-4849-9381-d71c4fd4bf9b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" Sep 09 17:46:31.222682 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.222660 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:31.224363 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.224335 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdpc7\" (UniqueName: \"kubernetes.io/projected/1c9bfe70-595e-4849-9381-d71c4fd4bf9b-kube-api-access-kdpc7\") pod \"limitador-operator-controller-manager-74495c69f8-mvbtq\" (UID: \"1c9bfe70-595e-4849-9381-d71c4fd4bf9b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" Sep 09 17:46:31.224672 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:46:31.224648 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zc8r6\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:31.258004 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.257975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:31.307445 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.307248 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp7s2\" (UniqueName: \"kubernetes.io/projected/1b8c1aef-b0bf-45a3-b1b9-e5c3013608be-kube-api-access-bp7s2\") pod \"1b8c1aef-b0bf-45a3-b1b9-e5c3013608be\" (UID: \"1b8c1aef-b0bf-45a3-b1b9-e5c3013608be\") " Sep 09 17:46:31.310018 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.309947 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8c1aef-b0bf-45a3-b1b9-e5c3013608be-kube-api-access-bp7s2" (OuterVolumeSpecName: "kube-api-access-bp7s2") pod "1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" (UID: "1b8c1aef-b0bf-45a3-b1b9-e5c3013608be"). InnerVolumeSpecName "kube-api-access-bp7s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 17:46:31.373111 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.373065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" Sep 09 17:46:31.408285 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.408251 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp7s2\" (UniqueName: \"kubernetes.io/projected/1b8c1aef-b0bf-45a3-b1b9-e5c3013608be-kube-api-access-bp7s2\") on node \"ip-10-0-130-216.ec2.internal\" DevicePath \"\"" Sep 09 17:46:31.489891 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.489795 2561 generic.go:356] "Generic (PLEG): container finished" podID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" containerID="2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710" exitCode=0 Sep 09 17:46:31.489891 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.489843 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:31.490414 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.489895 2561 scope.go:117] "RemoveContainer" containerID="2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710" Sep 09 17:46:31.492141 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:46:31.492114 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zc8r6\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:31.498793 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.498773 2561 scope.go:117] "RemoveContainer" containerID="2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710" Sep 09 17:46:31.499136 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:46:31.499115 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710\": container with ID starting with 2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710 not found: ID does not exist" containerID="2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710" Sep 09 17:46:31.499187 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.499148 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710"} err="failed to get container status \"2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710\": rpc error: code = NotFound desc = could not find container \"2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710\": container with ID starting with 2d3380b23992065419cfb406d8adaa24a57dd02a1687381025e6c507f7322710 not found: ID does not exist" Sep 09 17:46:31.502029 ip-10-0-130-216 kubenswrapper[2561]: E0909 17:46:31.502003 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zc8r6\" is forbidden: User \"system:node:ip-10-0-130-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-216.ec2.internal' and this object" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zc8r6" Sep 09 17:46:31.542503 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.542478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh"] Sep 09 17:46:31.545221 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:46:31.545191 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb760056b_1ec3_4ad1_9f39_2c7f98380d56.slice/crio-4cab92b5c258ae1789cdf72a3f349d13c60e91e022236eaf9eddd95f1cd35c7b WatchSource:0}: Error finding container 4cab92b5c258ae1789cdf72a3f349d13c60e91e022236eaf9eddd95f1cd35c7b: Status 404 returned error can't find the container with id 4cab92b5c258ae1789cdf72a3f349d13c60e91e022236eaf9eddd95f1cd35c7b Sep 09 17:46:31.646913 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.646725 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq"] Sep 09 17:46:31.649689 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:46:31.649658 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9bfe70_595e_4849_9381_d71c4fd4bf9b.slice/crio-ac79bb585d2752c055ee347583824387060b60501fcc1598ad7febfae23fa87b WatchSource:0}: Error finding container ac79bb585d2752c055ee347583824387060b60501fcc1598ad7febfae23fa87b: Status 404 returned error can't find the container with id ac79bb585d2752c055ee347583824387060b60501fcc1598ad7febfae23fa87b Sep 09 17:46:31.822631 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:31.822553 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b8c1aef-b0bf-45a3-b1b9-e5c3013608be" path="/var/lib/kubelet/pods/1b8c1aef-b0bf-45a3-b1b9-e5c3013608be/volumes" Sep 09 17:46:32.498949 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:32.498891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" event={"ID":"1c9bfe70-595e-4849-9381-d71c4fd4bf9b","Type":"ContainerStarted","Data":"4ccc2d683779e2b51410bac73e40ed431fee40c94cc49ba4a292350202fda168"} Sep 09 17:46:32.498949 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:32.498968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" event={"ID":"1c9bfe70-595e-4849-9381-d71c4fd4bf9b","Type":"ContainerStarted","Data":"ac79bb585d2752c055ee347583824387060b60501fcc1598ad7febfae23fa87b"} Sep 09 17:46:32.499498 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:32.499127 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" Sep 09 17:46:32.500626 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:32.500597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" event={"ID":"b760056b-1ec3-4ad1-9f39-2c7f98380d56","Type":"ContainerStarted","Data":"4cab92b5c258ae1789cdf72a3f349d13c60e91e022236eaf9eddd95f1cd35c7b"} Sep 09 17:46:32.520122 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:32.520058 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" podStartSLOduration=2.52003583 podStartE2EDuration="2.52003583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:46:32.517666818 +0000 UTC m=+373.166609649" watchObservedRunningTime="2026-09-09 17:46:32.52003583 +0000 UTC m=+373.168978642" Sep 09 17:46:35.517870 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:35.517836 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" event={"ID":"b760056b-1ec3-4ad1-9f39-2c7f98380d56","Type":"ContainerStarted","Data":"464e18ee0c921942a0b5a4e8be7502c88408c6ede5b1290e8039bd52c7b119c0"} Sep 09 17:46:35.518315 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:35.518007 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:46:35.537227 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:35.537174 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" podStartSLOduration=1.781477145 podStartE2EDuration="5.537159554s" totalImagesPullingTime="3.755682409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 17:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:46:35.536251583 +0000 UTC m=+376.185194400" watchObservedRunningTime="2026-09-09 17:46:35.537159554 +0000 UTC m=+376.186102369" Sep 09 17:46:43.509070 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:43.509029 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mvbtq" Sep 09 17:46:46.525140 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:46:46.525109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kzwvh" Sep 09 17:47:46.890619 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:46.890539 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j4l9w_7e538a1e-f5ab-4f85-827a-5acd8abf2c60/manager/0.log" Sep 09 17:47:47.029518 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:47.029488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6wgmr_a55333b8-1a0d-4a86-b098-9c667fda796c/manager/0.log" Sep 09 17:47:47.155079 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:47.155003 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-62rm5_28863f5b-9a41-47cc-89f8-a17c7bd9f576/server/0.log" Sep 09 17:47:47.314513 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:47.314477 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-84gmc_b086bf3f-39a1-4c18-9ad2-b0071e78365b/manager/0.log" Sep 09 17:47:47.735003 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:47.734974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d8b86c95-vdtth_6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3/copy-manifests/0.log" Sep 09 17:47:47.745479 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:47.745452 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d8b86c95-vdtth_6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3/manager/0.log" Sep 09 17:47:49.080964 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:49.080920 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-94bkb_68190801-80e4-4b8f-99c1-4771fc80b23d/manager/0.log" Sep 09 17:47:49.326158 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:49.326118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-kzwvh_b760056b-1ec3-4ad1-9f39-2c7f98380d56/manager/0.log" Sep 09 17:47:49.585508 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:49.585475 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-mvbtq_1c9bfe70-595e-4849-9381-d71c4fd4bf9b/manager/0.log" Sep 09 17:47:49.962835 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:49.962805 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r_e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308/istio-proxy/0.log" Sep 09 17:47:50.105174 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:50.105139 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fwvl2_5d79de73-4683-49dd-9ba7-c35e4d4cb57c/discovery/0.log" Sep 09 17:47:50.336386 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:47:50.336303 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fbc8bdbc-v57l7_354ebc3a-7b23-418d-846b-07177a66dbdc/kube-auth-proxy/0.log" Sep 09 17:48:02.053318 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:02.053288 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l8gf9_50d86b33-a0cf-462c-b284-e1672e2c7639/global-pull-secret-syncer/0.log" Sep 09 17:48:02.191293 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:02.191257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qbc6q_a87bee1a-d630-4591-a4b2-b2513f15b65b/konnectivity-agent/0.log" Sep 09 17:48:02.215611 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:02.215576 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-216.ec2.internal_1b6497d2a1dab0e32472faf9c39d7ed3/haproxy/0.log" Sep 09 17:48:06.795754 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:06.795661 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-94bkb_68190801-80e4-4b8f-99c1-4771fc80b23d/manager/0.log" Sep 09 17:48:06.872603 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:06.872568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-kzwvh_b760056b-1ec3-4ad1-9f39-2c7f98380d56/manager/0.log" Sep 09 17:48:06.925134 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:06.925106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-mvbtq_1c9bfe70-595e-4849-9381-d71c4fd4bf9b/manager/0.log" Sep 09 17:48:08.662890 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:08.662854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-rzr8c_4e57e764-728d-489a-81d3-f2c78f323c9f/kube-state-metrics/0.log" Sep 09 17:48:08.681346 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:08.681315 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-rzr8c_4e57e764-728d-489a-81d3-f2c78f323c9f/kube-rbac-proxy-main/0.log" Sep 09 17:48:08.703478 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:08.703425 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-rzr8c_4e57e764-728d-489a-81d3-f2c78f323c9f/kube-rbac-proxy-self/0.log" Sep 09 17:48:08.879515 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:08.879490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sc4cp_14ea0154-0a18-416c-bf27-d9f19acde25f/node-exporter/0.log" Sep 09 17:48:08.902270 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:08.902234 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sc4cp_14ea0154-0a18-416c-bf27-d9f19acde25f/kube-rbac-proxy/0.log" Sep 09 17:48:08.923759 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:08.923733 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sc4cp_14ea0154-0a18-416c-bf27-d9f19acde25f/init-textfile/0.log" Sep 09 17:48:09.038170 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.038140 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-n5mbd_b2b9c5dd-a80c-4066-a4da-c2fd294074c4/kube-rbac-proxy-main/0.log" Sep 09 17:48:09.065165 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.065135 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-n5mbd_b2b9c5dd-a80c-4066-a4da-c2fd294074c4/kube-rbac-proxy-self/0.log" Sep 09 17:48:09.091084 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.091052 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-n5mbd_b2b9c5dd-a80c-4066-a4da-c2fd294074c4/openshift-state-metrics/0.log" Sep 09 17:48:09.143289 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.143200 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_295ee992-40d3-4e32-9a9a-fabae1921b33/prometheus/0.log" Sep 09 17:48:09.165519 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.165493 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_295ee992-40d3-4e32-9a9a-fabae1921b33/config-reloader/0.log" Sep 09 17:48:09.191096 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.191067 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_295ee992-40d3-4e32-9a9a-fabae1921b33/thanos-sidecar/0.log" Sep 09 17:48:09.214664 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.214640 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_295ee992-40d3-4e32-9a9a-fabae1921b33/kube-rbac-proxy-web/0.log" Sep 09 17:48:09.245631 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.245604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_295ee992-40d3-4e32-9a9a-fabae1921b33/kube-rbac-proxy/0.log" Sep 09 17:48:09.268410 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.268384 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_295ee992-40d3-4e32-9a9a-fabae1921b33/kube-rbac-proxy-thanos/0.log" Sep 09 17:48:09.291398 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.291373 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_295ee992-40d3-4e32-9a9a-fabae1921b33/init-config-reloader/0.log" Sep 09 17:48:09.321125 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.321091 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-c57rn_8d469c0c-ac11-4e46-b97d-2536493232a5/prometheus-operator/0.log" Sep 09 17:48:09.342332 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:09.342298 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-c57rn_8d469c0c-ac11-4e46-b97d-2536493232a5/kube-rbac-proxy/0.log" Sep 09 17:48:12.108005 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.107966 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn"] Sep 09 17:48:12.111590 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.111572 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.113619 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.113558 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lqsbd\"/\"openshift-service-ca.crt\"" Sep 09 17:48:12.113740 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.113646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lqsbd\"/\"default-dockercfg-7k7t2\"" Sep 09 17:48:12.114149 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.114127 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lqsbd\"/\"kube-root-ca.crt\"" Sep 09 17:48:12.119763 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.119740 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn"] Sep 09 17:48:12.145762 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.145726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-proc\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.145986 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.145770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdtpx\" (UniqueName: \"kubernetes.io/projected/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-kube-api-access-mdtpx\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.145986 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.145792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-podres\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.145986 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.145908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-sys\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.146144 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.146027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-lib-modules\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247149 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdtpx\" (UniqueName: \"kubernetes.io/projected/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-kube-api-access-mdtpx\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247149 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-podres\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-sys\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-lib-modules\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-proc\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-podres\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-sys\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247418 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247393 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-proc\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.247608 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.247422 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-lib-modules\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.254780 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.254759 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdtpx\" (UniqueName: \"kubernetes.io/projected/ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65-kube-api-access-mdtpx\") pod \"perf-node-gather-daemonset-fgkdn\" (UID: \"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65\") " pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.262556 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.262534 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54445f59c6-dpwrr_a476733a-f243-4dda-82c6-c797d4125f78/console/0.log" Sep 09 17:48:12.422726 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.422624 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.692942 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.692878 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn"] Sep 09 17:48:12.695980 ip-10-0-130-216 kubenswrapper[2561]: W0909 17:48:12.695933 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podddd8634f_1ad9_4ef6_9d7c_826bab9e6e65.slice/crio-e13b53a534231fa483f8d14cea4d90812b62a2b4d8529c9d6ac4c82259ed4907 WatchSource:0}: Error finding container e13b53a534231fa483f8d14cea4d90812b62a2b4d8529c9d6ac4c82259ed4907: Status 404 returned error can't find the container with id e13b53a534231fa483f8d14cea4d90812b62a2b4d8529c9d6ac4c82259ed4907 Sep 09 17:48:12.973284 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.973183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" event={"ID":"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65","Type":"ContainerStarted","Data":"8245d4f04a4ea23b96c238e1118a061f153a37455785c16df2553d8c45aaa317"} Sep 09 17:48:12.973284 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.973240 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" event={"ID":"ddd8634f-1ad9-4ef6-9d7c-826bab9e6e65","Type":"ContainerStarted","Data":"e13b53a534231fa483f8d14cea4d90812b62a2b4d8529c9d6ac4c82259ed4907"} Sep 09 17:48:12.973509 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.973342 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:12.989479 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:12.989428 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" podStartSLOduration=0.989410619 podStartE2EDuration="989.410619ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 17:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 17:48:12.988727748 +0000 UTC m=+473.637670564" watchObservedRunningTime="2026-09-09 17:48:12.989410619 +0000 UTC m=+473.638353435" Sep 09 17:48:14.089970 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:14.089934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vd7b_8d5d149a-68c2-408e-a928-796af55ff36f/dns/0.log" Sep 09 17:48:14.111338 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:14.111312 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vd7b_8d5d149a-68c2-408e-a928-796af55ff36f/kube-rbac-proxy/0.log" Sep 09 17:48:14.208299 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:14.208272 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mgrxr_fbf6216f-f80d-48a6-944a-f96835051e16/dns-node-resolver/0.log" Sep 09 17:48:14.784587 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:14.784558 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hb6c_e489c1e7-7d01-48bc-bbb7-0100bd77706a/node-ca/0.log" Sep 09 17:48:15.782722 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:15.782681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r_e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308/istio-proxy/0.log" Sep 09 17:48:15.836895 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:15.836850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fwvl2_5d79de73-4683-49dd-9ba7-c35e4d4cb57c/discovery/0.log" Sep 09 17:48:15.885207 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:15.885182 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fbc8bdbc-v57l7_354ebc3a-7b23-418d-846b-07177a66dbdc/kube-auth-proxy/0.log" Sep 09 17:48:16.598328 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:16.598294 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t7wfs_3df191bb-652f-462d-a9db-0b0ac9d4558f/serve-healthcheck-canary/0.log" Sep 09 17:48:17.174347 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:17.174317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6b52c_3f0e91b7-fdb0-49b8-9dec-dee0b19a775e/kube-rbac-proxy/0.log" Sep 09 17:48:17.197972 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:17.197928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6b52c_3f0e91b7-fdb0-49b8-9dec-dee0b19a775e/exporter/0.log" Sep 09 17:48:17.221275 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:17.221244 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6b52c_3f0e91b7-fdb0-49b8-9dec-dee0b19a775e/extractor/0.log" Sep 09 17:48:18.987826 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:18.987800 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lqsbd/perf-node-gather-daemonset-fgkdn" Sep 09 17:48:19.375485 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:19.375396 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j4l9w_7e538a1e-f5ab-4f85-827a-5acd8abf2c60/manager/0.log" Sep 09 17:48:19.402732 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:19.402701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6wgmr_a55333b8-1a0d-4a86-b098-9c667fda796c/manager/0.log" Sep 09 17:48:19.426569 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:19.426542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-62rm5_28863f5b-9a41-47cc-89f8-a17c7bd9f576/server/0.log" Sep 09 17:48:19.490129 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:19.490091 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-84gmc_b086bf3f-39a1-4c18-9ad2-b0071e78365b/manager/0.log" Sep 09 17:48:19.637706 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:19.637584 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d8b86c95-vdtth_6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3/manager/0.log" Sep 09 17:48:19.662408 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:19.662384 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d8b86c95-vdtth_6d2a27ee-5e3e-44e0-b8e4-dc8830da85c3/copy-manifests/0.log" Sep 09 17:48:20.912823 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:20.912792 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8mgkm_c38c339a-9d7a-4e28-b468-3cc25e37c751/openshift-lws-operator/0.log" Sep 09 17:48:22.916075 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:22.916043 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r_e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308/istio-proxy/0.log" Sep 09 17:48:22.959870 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:22.959835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fwvl2_5d79de73-4683-49dd-9ba7-c35e4d4cb57c/discovery/0.log" Sep 09 17:48:22.991979 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:22.991938 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fbc8bdbc-v57l7_354ebc3a-7b23-418d-846b-07177a66dbdc/kube-auth-proxy/0.log" Sep 09 17:48:24.168986 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:24.168934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-dzq7r_e1f0f1eb-5a72-4f04-92c9-04e9d0b9a308/istio-proxy/0.log" Sep 09 17:48:24.214359 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:24.214330 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fwvl2_5d79de73-4683-49dd-9ba7-c35e4d4cb57c/discovery/0.log" Sep 09 17:48:24.245508 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:24.245482 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85fbc8bdbc-v57l7_354ebc3a-7b23-418d-846b-07177a66dbdc/kube-auth-proxy/0.log" Sep 09 17:48:27.767089 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:27.767062 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp64t_afd1ae53-ad9e-4894-a132-2a315fbea789/kube-multus-additional-cni-plugins/0.log" Sep 09 17:48:27.788818 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:27.788789 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp64t_afd1ae53-ad9e-4894-a132-2a315fbea789/egress-router-binary-copy/0.log" Sep 09 17:48:27.814230 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:27.814204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp64t_afd1ae53-ad9e-4894-a132-2a315fbea789/cni-plugins/0.log" Sep 09 17:48:27.843500 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:27.843465 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp64t_afd1ae53-ad9e-4894-a132-2a315fbea789/bond-cni-plugin/0.log" Sep 09 17:48:27.867943 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:27.867915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp64t_afd1ae53-ad9e-4894-a132-2a315fbea789/routeoverride-cni/0.log" Sep 09 17:48:27.892340 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:27.892261 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp64t_afd1ae53-ad9e-4894-a132-2a315fbea789/whereabouts-cni-bincopy/0.log" Sep 09 17:48:27.921502 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:27.921474 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cp64t_afd1ae53-ad9e-4894-a132-2a315fbea789/whereabouts-cni/0.log" Sep 09 17:48:28.167904 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:28.167817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qmqql_d9c17deb-7f67-40b9-93e8-357024b178f4/kube-multus/0.log" Sep 09 17:48:28.190480 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:28.190446 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9c82n_7d811657-ec09-4670-a288-cff11495d583/network-metrics-daemon/0.log" Sep 09 17:48:28.212245 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:28.212218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9c82n_7d811657-ec09-4670-a288-cff11495d583/kube-rbac-proxy/0.log" Sep 09 17:48:29.334869 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.334836 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-controller/0.log" Sep 09 17:48:29.355050 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.355018 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/1.log" Sep 09 17:48:29.355225 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.355068 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovn-acl-logging/0.log" Sep 09 17:48:29.372944 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.372913 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/kube-rbac-proxy-node/0.log" Sep 09 17:48:29.393891 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.393852 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 17:48:29.420619 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.420582 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/northd/0.log" Sep 09 17:48:29.443576 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.443547 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/nbdb/0.log" Sep 09 17:48:29.466279 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.466253 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/sbdb/0.log" Sep 09 17:48:29.517028 ip-10-0-130-216 kubenswrapper[2561]: I0909 17:48:29.516995 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qzgs_9564eb5a-61ba-4bc5-926d-9e3ebc86096a/ovnkube-controller/0.log"